Nov 29 13:13:33 user nova-compute[75071]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75071) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 13:13:33 user nova-compute[75071]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75071) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 13:13:33 user nova-compute[75071]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75071) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 13:13:33 user nova-compute[75071]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 13:13:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:13:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:13:34 user nova-compute[75071]: INFO nova.virt.driver [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 13:13:34 user nova-compute[75071]: INFO nova.compute.provider_config [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Acquiring lock "singleton_lock" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Acquired lock "singleton_lock" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Releasing lock "singleton_lock" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Full set of CONF: {{(pid=75071) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ******************************************************************************** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Configuration options gathered from: {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ================================================================================ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] allow_resize_to_same_host      = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] arq_binding_timeout            = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] backdoor_port                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] backdoor_socket                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] block_device_allocate_retries  = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] block_device_allocate_retries_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cert                           = self.pem {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute_monitors               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] config_dir                     = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] config_drive_format            = iso9660 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] config_source                  = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] console_host                   = user {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] control_exchange               = nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cpu_allocation_ratio           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] daemon                         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] debug                          = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] default_access_ip_network_name = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] default_availability_zone      = nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] default_ephemeral_format       = ext4 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] default_green_pool_size        = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] default_schedule_zone          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] disk_allocation_ratio          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] enable_new_services            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] enabled_ssl_apis               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] flat_injected                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] force_config_drive             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] force_raw_images               = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] graceful_shutdown_timeout      = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] heal_instance_info_cache_interval = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] host                           = user {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instance_build_timeout         = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instance_delete_interval       = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instance_name_template         = instance-%08x {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instance_usage_audit           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instance_usage_audit_period    = month {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] internal_service_availability_zone = internal {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] key                            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] live_migration_retry_count     = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_config_append              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_dir                        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_file                       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_options                    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_rotate_interval            = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_rotate_interval_type       = days {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] log_rotation_type              = none {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] long_rpc_timeout               = 1800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] max_concurrent_builds          = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] max_concurrent_live_migrations = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] max_concurrent_snapshots       = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] max_local_block_devices        = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] max_logfile_count              = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] max_logfile_size_mb            = 200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] maximum_instance_delete_attempts = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] metadata_listen                = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] metadata_listen_port           = 8775 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] metadata_workers               = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] migrate_max_retries            = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] mkisofs_cmd                    = genisoimage {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] my_ip                          = 10.0.0.210 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] network_allocate_retries       = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] osapi_compute_listen_port      = 8774 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] osapi_compute_unique_server_name_scope =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] osapi_compute_workers          = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] password_length                = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] periodic_enable                = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] periodic_fuzzy_delay           = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] pointer_model                  = ps2mouse {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] preallocate_images             = none {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] publish_errors                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] pybasedir                      = /opt/stack/nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ram_allocation_ratio           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rate_limit_burst               = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rate_limit_except_level        = CRITICAL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rate_limit_interval            = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] reboot_timeout                 = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] reclaim_instance_interval      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] record                         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] reimage_timeout_per_gb         = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] report_interval                = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rescue_timeout                 = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] reserved_host_cpus             = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] reserved_host_disk_mb          = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] reserved_host_memory_mb        = 512 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] reserved_huge_pages            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] resize_confirm_window          = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] resize_fs_using_block_device   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] resume_guests_state_on_host_boot = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rpc_response_timeout           = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] run_external_periodic_tasks    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] running_deleted_instance_action = reap {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] running_deleted_instance_timeout = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler_instance_sync_interval = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_down_time              = 720 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] servicegroup_driver            = db {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] shelved_offload_time           = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] shelved_poll_interval          = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] shutdown_timeout               = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] source_is_ipv6                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ssl_only                       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] state_path                     = /opt/stack/data/nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] sync_power_state_interval      = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] sync_power_state_pool_size     = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] syslog_log_facility            = LOG_USER {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] tempdir                        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] timeout_nbd                    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] transport_url                  = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] update_resources_interval      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] use_cow_images                 = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] use_eventlog                   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] use_journal                    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] use_json                       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] use_rootwrap_daemon            = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] use_stderr                     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] use_syslog                     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vcpu_pin_set                   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plugging_is_fatal          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plugging_timeout           = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] virt_mkfs                      = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] volume_usage_poll_interval     = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] watch_log_file                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] web                            = /usr/share/spice-html5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_concurrency.disable_process_locking = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.auth_strategy              = keystone {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.compute_link_prefix        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.dhcp_domain                = novalocal {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.enable_instance_password   = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.glance_link_prefix         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.instance_list_per_project_cells = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.list_records_by_skipping_down_cells = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.local_metadata_per_cell    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.max_limit                  = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.metadata_cache_expiration  = 15 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.neutron_default_tenant_id  = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.use_forwarded_for          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.use_neutron_default_nets   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.vendordata_dynamic_targets = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.vendordata_jsonfile_path   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.backend_argument         = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.config_prefix            = cache.oslo {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.dead_timeout             = 60.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.debug_cache_backend      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.enable_retry_client      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.enable_socket_keepalive  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.enabled                  = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.expiration_time          = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.hashclient_retry_attempts = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_dead_retry      = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_password        =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_sasl_enabled    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.memcache_username        =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.proxies                  = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.retry_attempts           = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.retry_delay              = 0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.socket_keepalive_count   = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.socket_keepalive_idle    = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.socket_keepalive_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.tls_allowed_ciphers      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.tls_cafile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.tls_certfile             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.tls_enabled              = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cache.tls_keyfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.auth_section            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.auth_type               = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.cross_az_attach         = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.debug                   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.endpoint_template       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.http_retries            = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.os_region_name          = RegionOne {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cinder.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.cpu_dedicated_set      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.cpu_shared_set         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.image_type_exclude_list = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.resource_provider_association_refresh = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.shutdown_retry_interval = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] conductor.workers              = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] console.allowed_origins        = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] console.ssl_ciphers            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] console.ssl_minimum_version    = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] consoleauth.token_ttl          = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.connect_retries         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.connect_retry_delay     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.endpoint_override       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.max_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.min_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.region_name             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.service_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.service_type            = accelerator {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.status_code_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] cyborg.version                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.backend               = sqlalchemy {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.connection            = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.connection_debug      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.connection_parameters =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.connection_recycle_time = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.connection_trace      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.db_inc_retry_interval = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.db_max_retries        = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.db_max_retry_interval = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.db_retry_interval     = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.max_overflow          = 50 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.max_pool_size         = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.max_retries           = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.mysql_wsrep_sync_wait = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.pool_timeout          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.retry_interval        = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.slave_connection      = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] database.sqlite_synchronous    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.backend           = sqlalchemy {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.connection        = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.connection_debug  = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.connection_parameters =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.connection_recycle_time = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.connection_trace  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.db_inc_retry_interval = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.db_max_retries    = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.db_max_retry_interval = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.db_retry_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.max_overflow      = 50 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.max_pool_size     = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.max_retries       = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.pool_timeout      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.retry_interval    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.slave_connection  = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] api_database.sqlite_synchronous = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] devices.enabled_mdev_types     = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ephemeral_storage_encryption.enabled = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.api_servers             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.connect_retries         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.connect_retry_delay     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.debug                   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.default_trusted_certificate_ids = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.enable_certificate_validation = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.enable_rbd_download     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.endpoint_override       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.max_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.min_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.num_retries             = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.rbd_ceph_conf           =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.rbd_connect_timeout     = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.rbd_pool                =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.rbd_user                =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.region_name             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.service_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.service_type            = image {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.status_code_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.verify_glance_signatures = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] glance.version                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] guestfs.debug                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.config_drive_cdrom      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.config_drive_inject_password = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.enable_remotefx         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.instances_path_share    =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.limit_cpu_features      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.use_multipath_io        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.vswitch_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] mks.enabled                    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] image_cache.manager_interval   = 2400 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] image_cache.precache_concurrency = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] image_cache.remove_unused_base_images = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] image_cache.subdirectory_name  = _base {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.api_max_retries         = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.api_retry_interval      = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.auth_section            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.auth_type               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.conductor_group         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.connect_retries         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.connect_retry_delay     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.endpoint_override       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.max_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.min_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.peer_list               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.region_name             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.serial_console_state_timeout = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.service_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.service_type            = baremetal {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.status_code_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ironic.version                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] key_manager.fixed_key          = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.barbican_api_version  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.barbican_endpoint     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.barbican_endpoint_type = public {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.barbican_region_name  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.cafile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.certfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.collect_timing        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.insecure              = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.keyfile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.number_of_retries     = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.retry_delay           = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.send_service_user_token = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.split_loggers         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.timeout               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.verify_ssl            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican.verify_ssl_path       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.auth_section = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.auth_type = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.cafile   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.certfile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.collect_timing = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.insecure = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.keyfile  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.split_loggers = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] barbican_service_user.timeout  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.approle_role_id          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.approle_secret_id        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.cafile                   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.certfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.collect_timing           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.insecure                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.keyfile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.kv_mountpoint            = secret {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.kv_path                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.kv_version               = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.namespace                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.root_token_id            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.split_loggers            = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.ssl_ca_crt_file          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.timeout                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.use_ssl                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.auth_section          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.auth_type             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.cafile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.certfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.collect_timing        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.connect_retries       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.connect_retry_delay   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.endpoint_override     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.insecure              = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.keyfile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.max_version           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.min_version           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.region_name           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.service_name          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.service_type          = identity {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.split_loggers         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.status_code_retries   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.timeout               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] keystone.version               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.connection_uri         =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.cpu_mode               = custom {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: WARNING oslo_config.cfg [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.cpu_power_governor_high = performance {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.cpu_power_management   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.device_detach_attempts = 8 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.device_detach_timeout  = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.disk_cachemodes        = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.disk_prefix            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.enabled_perf_events    = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.file_backed_memory     = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.gid_maps               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.hw_disk_discard        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.hw_machine_type        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.images_rbd_pool        = rbd {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.images_type            = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.images_volume_group    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.inject_key             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.inject_partition       = -2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.inject_password        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.iscsi_iface            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.iser_use_multipath     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_downtime = 500 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_inbound_addr = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_scheme  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_timeout_action = abort {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_tunnelled = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: WARNING oslo_config.cfg [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 13:13:34 user nova-compute[75071]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 13:13:34 user nova-compute[75071]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 13:13:34 user nova-compute[75071]: and ``live_migration_inbound_addr`` respectively.
Nov 29 13:13:34 user nova-compute[75071]: ).  Its value may be silently ignored in the future.
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.live_migration_with_native_tls = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.max_queues             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.nfs_mount_options      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.num_pcie_ports         = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.pmem_namespaces        = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.quobyte_client_cfg     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rbd_secret_uuid        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rbd_user               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rescue_image_id        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rescue_kernel_id       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.rx_queue_size          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.smbfs_mount_options    =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.snapshot_compression   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.snapshot_image_format  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.sparse_logical_volumes = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.swtpm_enabled          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.swtpm_group            = tss {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.swtpm_user             = tss {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.sysinfo_serial         = unique {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.tb_cache_size          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.tx_queue_size          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.uid_maps               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.use_virtio_for_bridges = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.virt_type              = kvm {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.volume_clear           = zero {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.volume_clear_size      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.volume_use_multipath   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.vzstorage_cache_path   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.auth_section           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.auth_type              = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.cafile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.certfile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.collect_timing         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.connect_retries        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.connect_retry_delay    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.default_floating_pool  = public {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.endpoint_override      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.extension_sync_interval = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.http_retries           = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.insecure               = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.keyfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.max_version            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.min_version            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.ovs_bridge             = br-int {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.physnets               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.region_name            = RegionOne {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.service_metadata_proxy = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.service_name           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.service_type           = network {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.split_loggers          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.status_code_retries    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.timeout                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] neutron.version                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] notifications.bdms_in_notifications = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] notifications.default_level    = INFO {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] notifications.notification_format = unversioned {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] notifications.notify_on_state_change = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] pci.alias                      = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] pci.device_spec                = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] pci.report_in_placement        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.auth_section         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.auth_type            = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.cafile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.certfile             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.collect_timing       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.connect_retries      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.connect_retry_delay  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.default_domain_id    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.default_domain_name  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.domain_id            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.domain_name          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.endpoint_override    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.insecure             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.keyfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.max_version          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.min_version          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.password             = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.project_domain_id    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.project_domain_name  = Default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.project_id           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.project_name         = service {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.region_name          = RegionOne {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.service_name         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.service_type         = placement {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.split_loggers        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.status_code_retries  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.system_scope         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.timeout              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.trust_id             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.user_domain_id       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.user_domain_name     = Default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.user_id              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.username             = placement {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] placement.version              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.cores                    = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.count_usage_from_placement = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.injected_file_content_bytes = 10240 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.injected_file_path_length = 255 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.injected_files           = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.instances                = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.key_pairs                = 100 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.metadata_items           = 128 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.ram                      = 51200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.recheck_quota            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.server_group_members     = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] quota.server_groups            = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rdp.enabled                    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.image_metadata_prefilter = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.max_attempts         = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.max_placement_results = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] scheduler.workers              = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.host_subset_size = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.isolated_hosts = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.isolated_images = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.pci_in_placement = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.track_instance_changes = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] metrics.required               = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] metrics.weight_multiplier      = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] metrics.weight_setting         = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] serial_console.enabled         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] serial_console.port_range      = 10000:20000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] serial_console.serialproxy_port = 6083 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.auth_section      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.auth_type         = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.cafile            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.certfile          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.collect_timing    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.insecure          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.keyfile           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.send_service_user_token = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.split_loggers     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] service_user.timeout           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.agent_enabled            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.enabled                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.html5proxy_port          = 6082 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.image_compression        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.jpeg_compression         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.playback_compression     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.server_listen            = 127.0.0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.streaming_mode           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] spice.zlib_compression         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] upgrade_levels.baseapi         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] upgrade_levels.compute         = auto {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] upgrade_levels.conductor       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] upgrade_levels.scheduler       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.cafile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.certfile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.insecure = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vendordata_dynamic_auth.timeout = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.api_retry_count         = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.ca_file                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.cache_prefix            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.cluster_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.connection_pool_size    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.console_delay_seconds   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.datastore_regex         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.host_ip                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.host_password           = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.host_port               = 443 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.host_username           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.integration_bridge      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.maximum_objects         = 100 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.pbm_default_policy      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.pbm_enabled             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.pbm_wsdl_location       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.serial_port_proxy_uri   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.serial_port_service_uri = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.task_poll_interval      = 0.5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.use_linked_clone        = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.vnc_keymap              = en-us {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.vnc_port                = 5900 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vmware.vnc_port_total          = 10000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.auth_schemes               = ['none'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.enabled                    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.novncproxy_port            = 6080 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.vencrypt_ca_certs          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.vencrypt_client_cert       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vnc.vencrypt_client_key        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.disable_rootwrap   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.enable_numa_live_migration = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.libvirt_disable_apic = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.client_socket_timeout     = 900 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.default_pool_size         = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.keep_alive                = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.max_header_line           = 16384 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.ssl_ca_file               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.ssl_cert_file             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.ssl_key_file              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.tcp_keepidle              = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] zvm.ca_file                    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] zvm.cloud_connector_url        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] zvm.reachable_timeout          = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.enforce_new_defaults = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.enforce_scope      = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.policy_default_rule = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.connection_string     = messaging:// {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.enabled               = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.es_doc_type           = notification {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.es_scroll_size        = 10000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.es_scroll_time        = 2m {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.filter_error_trace    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.hmac_keys             = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.sentinel_service_name = mymaster {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.socket_timeout        = 0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.trace_requests        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler.trace_sqlalchemy      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler_jaeger.process_tags   = {} {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler_jaeger.service_name_prefix = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] profiler_otlp.service_name_prefix = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] remote_debug.host              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] remote_debug.port              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_notifications.retry = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.auth_section        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.auth_type           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.cafile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.certfile            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.collect_timing      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.connect_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.connect_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.endpoint_id         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.endpoint_override   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.insecure            = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.keyfile             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.max_version         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.min_version         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.region_name         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.service_name        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.service_type        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.split_loggers       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.status_code_retries = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.timeout             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.valid_interfaces    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_limit.version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_reports.file_event_handler = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] oslo_reports.log_dir           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_ovs_privileged.group  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] vif_plug_ovs_privileged.user   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_ovs.isolate_vif         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] os_brick.lock_path             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] privsep_osbrick.capabilities   = [21] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] privsep_osbrick.group          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] privsep_osbrick.helper_command = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] privsep_osbrick.user           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] nova_sys_admin.group           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] nova_sys_admin.helper_command  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] nova_sys_admin.user            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-f3282b05-2ed9-407a-b5a9-dd33cdfe47d6 None None] ******************************************************************************** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 13:13:34 user nova-compute[75071]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 13:13:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Connecting to libvirt: qemu:///system {{(pid=75071) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f216c52a3b0> {{(pid=75071) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 13:13:34 user nova-compute[75071]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 13:13:34 user nova-compute[75071]: WARNING nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 13:13:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f216c52a3b0> {{(pid=75071) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Starting native event thread {{(pid=75071) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Starting green dispatch thread {{(pid=75071) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 13:13:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Starting connection event dispatch thread {{(pid=75071) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 13:13:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Connection event '1' reason 'None'
Nov 29 13:13:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 13:13:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.mount [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Initialising _HostMountState generation 0 {{(pid=75071) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 13:13:42 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host capabilities <capabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <host>
Nov 29 13:13:42 user nova-compute[75071]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 13:13:42 user nova-compute[75071]:     <cpu>
Nov 29 13:13:42 user nova-compute[75071]:       <arch>x86_64</arch>
Nov 29 13:13:42 user nova-compute[75071]:       <model>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <microcode version='1070'/>
Nov 29 13:13:42 user nova-compute[75071]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 13:13:42 user nova-compute[75071]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='osxsave'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='invtsc'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='rsba'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 13:13:42 user nova-compute[75071]:       <pages unit='KiB' size='4'/>
Nov 29 13:13:42 user nova-compute[75071]:       <pages unit='KiB' size='2048'/>
Nov 29 13:13:42 user nova-compute[75071]:     </cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <power_management>
Nov 29 13:13:42 user nova-compute[75071]:       <suspend_mem/>
Nov 29 13:13:42 user nova-compute[75071]:       <suspend_disk/>
Nov 29 13:13:42 user nova-compute[75071]:       <suspend_hybrid/>
Nov 29 13:13:42 user nova-compute[75071]:     </power_management>
Nov 29 13:13:42 user nova-compute[75071]:     <iommu support='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <migration_features>
Nov 29 13:13:42 user nova-compute[75071]:       <live/>
Nov 29 13:13:42 user nova-compute[75071]:       <uri_transports>
Nov 29 13:13:42 user nova-compute[75071]:         <uri_transport>tcp</uri_transport>
Nov 29 13:13:42 user nova-compute[75071]:         <uri_transport>rdma</uri_transport>
Nov 29 13:13:42 user nova-compute[75071]:       </uri_transports>
Nov 29 13:13:42 user nova-compute[75071]:     </migration_features>
Nov 29 13:13:42 user nova-compute[75071]:     <topology>
Nov 29 13:13:42 user nova-compute[75071]:       <cells num='2'>
Nov 29 13:13:42 user nova-compute[75071]:         <cell id='0'>
Nov 29 13:13:42 user nova-compute[75071]:           <memory unit='KiB'>8189224</memory>
Nov 29 13:13:42 user nova-compute[75071]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 29 13:13:42 user nova-compute[75071]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 13:13:42 user nova-compute[75071]:           <distances>
Nov 29 13:13:42 user nova-compute[75071]:             <sibling id='0' value='10'/>
Nov 29 13:13:42 user nova-compute[75071]:             <sibling id='1' value='20'/>
Nov 29 13:13:42 user nova-compute[75071]:           </distances>
Nov 29 13:13:42 user nova-compute[75071]:           <cpus num='6'>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 13:13:42 user nova-compute[75071]:           </cpus>
Nov 29 13:13:42 user nova-compute[75071]:         </cell>
Nov 29 13:13:42 user nova-compute[75071]:         <cell id='1'>
Nov 29 13:13:42 user nova-compute[75071]:           <memory unit='KiB'>8206460</memory>
Nov 29 13:13:42 user nova-compute[75071]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 29 13:13:42 user nova-compute[75071]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 13:13:42 user nova-compute[75071]:           <distances>
Nov 29 13:13:42 user nova-compute[75071]:             <sibling id='0' value='20'/>
Nov 29 13:13:42 user nova-compute[75071]:             <sibling id='1' value='10'/>
Nov 29 13:13:42 user nova-compute[75071]:           </distances>
Nov 29 13:13:42 user nova-compute[75071]:           <cpus num='6'>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 13:13:42 user nova-compute[75071]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 13:13:42 user nova-compute[75071]:           </cpus>
Nov 29 13:13:42 user nova-compute[75071]:         </cell>
Nov 29 13:13:42 user nova-compute[75071]:       </cells>
Nov 29 13:13:42 user nova-compute[75071]:     </topology>
Nov 29 13:13:42 user nova-compute[75071]:     <cache>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 13:13:42 user nova-compute[75071]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 13:13:42 user nova-compute[75071]:     </cache>
Nov 29 13:13:42 user nova-compute[75071]:     <secmodel>
Nov 29 13:13:42 user nova-compute[75071]:       <model>apparmor</model>
Nov 29 13:13:42 user nova-compute[75071]:       <doi>0</doi>
Nov 29 13:13:42 user nova-compute[75071]:     </secmodel>
Nov 29 13:13:42 user nova-compute[75071]:     <secmodel>
Nov 29 13:13:42 user nova-compute[75071]:       <model>dac</model>
Nov 29 13:13:42 user nova-compute[75071]:       <doi>0</doi>
Nov 29 13:13:42 user nova-compute[75071]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 13:13:42 user nova-compute[75071]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 13:13:42 user nova-compute[75071]:     </secmodel>
Nov 29 13:13:42 user nova-compute[75071]:   </host>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='alpha'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>clipper</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='armv6l'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>spitz</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>nuri</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>kzm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sx1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>z2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>tosa</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>n810</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>n800</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>terrier</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>midway</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>microbit</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>verdex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>highbank</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>akita</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>connex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>collie</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='armv7l'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>spitz</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>nuri</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>kzm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sx1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>z2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>tosa</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>n810</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>n800</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>terrier</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>midway</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>microbit</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>verdex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>highbank</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>akita</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>connex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>collie</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='aarch64'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>spitz</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>nuri</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>kzm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sx1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>z2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>tosa</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>n810</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>n800</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>terrier</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>midway</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>microbit</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>verdex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>highbank</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>akita</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>connex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>collie</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <acpi default='on' toggle='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='cris'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='i686'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>isapc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>microvm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='kvm'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <pae/>
Nov 29 13:13:42 user nova-compute[75071]:       <nonpae/>
Nov 29 13:13:42 user nova-compute[75071]:       <acpi default='on' toggle='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:       <apic default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='m68k'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>an5206</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>q800</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='microblaze'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='microblazeel'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='mips'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='mipsel'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='mips64'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>pica61</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>magnum</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='mips64el'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>pica61</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>magnum</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='16'>boston</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='ppc'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mac99</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>40p</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>taihu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='ppc64'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>taihu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>40p</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mac99</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='ppc64le'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>taihu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>40p</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>mac99</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='riscv32'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='8'>spike</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='8'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='riscv64'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='8'>spike</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='8'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='s390x'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='sh4'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>shix</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>r2d</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='sh4eb'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>shix</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>r2d</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='sparc'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>LX</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='sparc64'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>niagara</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='x86_64'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>64</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='1'>isapc</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>microvm</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='kvm'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <acpi default='on' toggle='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:       <apic default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='xtensa'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>sim</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>kc705</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>ml605</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx200</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx60</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]:   <guest>
Nov 29 13:13:42 user nova-compute[75071]:     <os_type>hvm</os_type>
Nov 29 13:13:42 user nova-compute[75071]:     <arch name='xtensaeb'>
Nov 29 13:13:42 user nova-compute[75071]:       <wordsize>32</wordsize>
Nov 29 13:13:42 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='4'>sim</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>kc705</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>ml605</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>virt</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx200</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>lx60</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 13:13:42 user nova-compute[75071]:       <domain type='qemu'/>
Nov 29 13:13:42 user nova-compute[75071]:     </arch>
Nov 29 13:13:42 user nova-compute[75071]:     <features>
Nov 29 13:13:42 user nova-compute[75071]:       <cpuselection/>
Nov 29 13:13:42 user nova-compute[75071]:       <deviceboot/>
Nov 29 13:13:42 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     </features>
Nov 29 13:13:42 user nova-compute[75071]:   </guest>
Nov 29 13:13:42 user nova-compute[75071]: </capabilities>
Nov 29 13:13:42 user nova-compute[75071]: 
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-i440fx-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>i686</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='255'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'/>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ide</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-i440fx-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>i686</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='255'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'/>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ide</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-q35-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>i686</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='288'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'/>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-q35-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>i686</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='288'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'/>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-i440fx-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>x86_64</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='255'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>efi</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ide</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-i440fx-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>x86_64</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='255'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>efi</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ide</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-q35-jammy</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>x86_64</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='288'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>efi</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 13:13:42 user nova-compute[75071]: <domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 13:13:42 user nova-compute[75071]:   <domain>kvm</domain>
Nov 29 13:13:42 user nova-compute[75071]:   <machine>pc-q35-6.2</machine>
Nov 29 13:13:42 user nova-compute[75071]:   <arch>x86_64</arch>
Nov 29 13:13:42 user nova-compute[75071]:   <vcpu max='288'/>
Nov 29 13:13:42 user nova-compute[75071]:   <iothreads supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:   <os supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='firmware'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>efi</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:     <loader supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>rom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pflash</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='readonly'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='secure'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>yes</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>no</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </loader>
Nov 29 13:13:42 user nova-compute[75071]:   </os>
Nov 29 13:13:42 user nova-compute[75071]:   <cpu>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='maximumMigratable'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>on</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>off</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <vendor>Intel</vendor>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Nov 29 13:13:42 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>phenom</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>n270</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>athlon</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Nov 29 13:13:42 user nova-compute[75071]:       <model usable='yes'>486</model>
Nov 29 13:13:42 user nova-compute[75071]:     </mode>
Nov 29 13:13:42 user nova-compute[75071]:   </cpu>
Nov 29 13:13:42 user nova-compute[75071]:   <memoryBacking supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:     <enum name='sourceType'>
Nov 29 13:13:42 user nova-compute[75071]:       <value>file</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>anonymous</value>
Nov 29 13:13:42 user nova-compute[75071]:       <value>memfd</value>
Nov 29 13:13:42 user nova-compute[75071]:     </enum>
Nov 29 13:13:42 user nova-compute[75071]:   </memoryBacking>
Nov 29 13:13:42 user nova-compute[75071]:   <devices>
Nov 29 13:13:42 user nova-compute[75071]:     <disk supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='diskDevice'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>disk</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cdrom</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>floppy</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>lun</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='bus'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>fdc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sata</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </disk>
Nov 29 13:13:42 user nova-compute[75071]:     <graphics supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='type'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>sdl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vnc</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>spice</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egl-headless</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </graphics>
Nov 29 13:13:42 user nova-compute[75071]:     <video supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='modelType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>cirrus</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>vmvga</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>qxl</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>none</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>bochs</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>ramfb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </video>
Nov 29 13:13:42 user nova-compute[75071]:     <hostdev supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='mode'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>subsystem</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='startupPolicy'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>default</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>mandatory</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>requisite</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>optional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='subsysType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>usb</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>pci</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>scsi</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='capsType'/>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='pciBackend'/>
Nov 29 13:13:42 user nova-compute[75071]:     </hostdev>
Nov 29 13:13:42 user nova-compute[75071]:     <rng supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>random</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>egd</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>builtin</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </rng>
Nov 29 13:13:42 user nova-compute[75071]:     <filesystem supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='driverType'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>path</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>handle</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>virtiofs</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </filesystem>
Nov 29 13:13:42 user nova-compute[75071]:     <tpm supported='yes'>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='model'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-tis</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>tpm-crb</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:       <enum name='backendModel'>
Nov 29 13:13:42 user nova-compute[75071]:         <value>passthrough</value>
Nov 29 13:13:42 user nova-compute[75071]:         <value>emulator</value>
Nov 29 13:13:42 user nova-compute[75071]:       </enum>
Nov 29 13:13:42 user nova-compute[75071]:     </tpm>
Nov 29 13:13:42 user nova-compute[75071]:   </devices>
Nov 29 13:13:42 user nova-compute[75071]:   <features>
Nov 29 13:13:42 user nova-compute[75071]:     <gic supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <genid supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <backup supported='yes'/>
Nov 29 13:13:42 user nova-compute[75071]:     <sev supported='no'/>
Nov 29 13:13:42 user nova-compute[75071]:   </features>
Nov 29 13:13:42 user nova-compute[75071]: </domainCapabilities>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Checking secure boot support for host arch (x86_64) {{(pid=75071) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Checking secure boot support for host arch (x86_64) {{(pid=75071) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Checking secure boot support for host arch (x86_64) {{(pid=75071) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Checking secure boot support for host arch (x86_64) {{(pid=75071) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Checking secure boot support for host arch (x86_64) {{(pid=75071) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 13:13:42 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Secure Boot support detected
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] cpu compare xml: <cpu match="exact">
Nov 29 13:13:42 user nova-compute[75071]:   <model>Nehalem</model>
Nov 29 13:13:42 user nova-compute[75071]: </cpu>
Nov 29 13:13:42 user nova-compute[75071]:  {{(pid=75071) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 13:13:42 user nova-compute[75071]: INFO nova.virt.node [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Generated node identity e517bf91-8e31-44c7-82cf-bb88030161c7
Nov 29 13:13:42 user nova-compute[75071]: INFO nova.virt.node [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Wrote node identity e517bf91-8e31-44c7-82cf-bb88030161c7 to /opt/stack/data/nova/compute_id
Nov 29 13:13:42 user nova-compute[75071]: WARNING nova.compute.manager [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Compute nodes ['e517bf91-8e31-44c7-82cf-bb88030161c7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 13:13:42 user nova-compute[75071]: INFO nova.compute.manager [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 13:13:42 user nova-compute[75071]: WARNING nova.compute.manager [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 13:13:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:13:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:13:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:13:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Hypervisor/Node resource view: name=user free_ram=10969MB free_disk=26.079357147216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:13:43 user nova-compute[75071]: WARNING nova.compute.resource_tracker [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] No compute node record for user:e517bf91-8e31-44c7-82cf-bb88030161c7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e517bf91-8e31-44c7-82cf-bb88030161c7 could not be found.
Nov 29 13:13:43 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Compute node record created for user:user with uuid: e517bf91-8e31-44c7-82cf-bb88030161c7
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:13:43 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] [req-14fa2727-412a-481d-af5c-cd2864ab8ba5] Created resource provider record via placement API for resource provider with UUID e517bf91-8e31-44c7-82cf-bb88030161c7 and name user.
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75071) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 13:13:43 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] kernel doesn't support AMD SEV
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Libvirt baseline CPU <cpu>
Nov 29 13:13:43 user nova-compute[75071]:   <arch>x86_64</arch>
Nov 29 13:13:43 user nova-compute[75071]:   <model>Nehalem</model>
Nov 29 13:13:43 user nova-compute[75071]:   <vendor>Intel</vendor>
Nov 29 13:13:43 user nova-compute[75071]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 13:13:43 user nova-compute[75071]: </cpu>
Nov 29 13:13:43 user nova-compute[75071]:  {{(pid=75071) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Updated inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Updating resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 generation from 0 to 1 during operation: update_inventory {{(pid=75071) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Updating resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 generation from 1 to 2 during operation: update_traits {{(pid=75071) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.service [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Creating RPC server for service compute {{(pid=75071) start /opt/stack/nova/nova/service.py:182}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.service [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] Join ServiceGroup membership for this service compute {{(pid=75071) start /opt/stack/nova/nova/service.py:199}}
Nov 29 13:13:43 user nova-compute[75071]: DEBUG nova.servicegroup.drivers.db [None req-90179b61-82e5-475e-87c2-3bcd6c95971b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75071) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 13:14:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:14:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:14:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=10400MB free_disk=25.983135223388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:14:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:15:36 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:15:36 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:15:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=10329MB free_disk=26.04813003540039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:16:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:16:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=10313MB free_disk=25.800674438476562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:17:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:17:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:17:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:17:38 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:17:38 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:17:38 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=9642MB free_disk=25.820938110351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:17:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:17:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:17:47 user nova-compute[75071]: INFO nova.compute.claims [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Claim successful on node user
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:17:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:17:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Creating image(s)
Nov 29 13:17:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "/opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "/opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "/opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:49 user nova-compute[75071]: DEBUG nova.policy [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd83bac00dc8a40559ff4b0f0673c79a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a7845e453c40d59a3fc56db2d3beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:17:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG nova.virt.images [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] 794347ff-8cf3-49d9-8652-9f89337799af was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.part /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.part /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.converted" returned: 0 in 0.219s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.927s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:50 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplczvam1q/privsep.sock']
Nov 29 13:17:50 user sudo[84316]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplczvam1q/privsep.sock
Nov 29 13:17:50 user sudo[84316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 13:17:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:17:51 user nova-compute[75071]: INFO nova.compute.claims [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Claim successful on node user
Nov 29 13:17:51 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:17:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:17:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:17:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:17:52 user sudo[84316]: pam_unix(sudo:session): session closed for user root
Nov 29 13:17:52 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Spawned new privsep daemon via rootwrap
Nov 29 13:17:52 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 13:17:52 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 13:17:52 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 13:17:52 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84323
Nov 29 13:17:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:17:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Creating image(s)
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "/opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "/opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "/opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:52 user nova-compute[75071]: WARNING oslo_privsep.priv_context [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] privsep daemon already running
Nov 29 13:17:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Successfully created port: 166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG nova.policy [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8395b32f70af4fd782ad81a609e9f63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5f5e7553949989e7fc90db828a0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.270s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk 1073741824" returned: 0 in 0.075s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.165s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk 1073741824" returned: 0 in 0.053s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Cannot resize image /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Ensure instance console log exists: /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Cannot resize image /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Ensure instance console log exists: /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:17:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Successfully created port: c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:17:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Successfully updated port: 166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquired lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:17:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received event network-changed-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Refreshing instance network info cache due to event network-changed-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] Acquiring lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Successfully updated port: c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:17:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-changed-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Refreshing instance network info cache due to event network-changed-c4e3d926-2ca7-42cc-9a76-5bc4db72803e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updating instance_info_cache with network_info: [{"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Releasing lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Instance network_info: |[{"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] Acquired lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Refreshing network info cache for port 166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:17:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Start _get_guest_xml network_info=[{"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:17:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:17:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-365256680',display_name='tempest-ServersNegativeTestJSON-server-365256680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-365256680',id=1,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a7845e453c40d59a3fc56db2d3beb0',ramdisk_id='',reservation_id='r-ayba00sx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-308617736',owner_user_name='tempest-ServersNegativeTestJSON-308617736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:17:49Z,user_data=None,user_id='d83bac00dc8a40559ff4b0f0673c79a0',uuid=945db3bb-5653-48f8-9c5f-2be1984e3cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converting VIF {"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:e6:d3,bridge_name='br-int',has_traffic_filtering=True,id=166a8bc2-c197-4ecc-a2f8-e3bbe84683e9,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a8bc2-c1') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lazy-loading 'pci_devices' on Instance uuid 945db3bb-5653-48f8-9c5f-2be1984e3cd2 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:17:58 user nova-compute[75071]:   <uuid>945db3bb-5653-48f8-9c5f-2be1984e3cd2</uuid>
Nov 29 13:17:58 user nova-compute[75071]:   <name>instance-00000001</name>
Nov 29 13:17:58 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:17:58 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:17:58 user nova-compute[75071]:   <metadata>
Nov 29 13:17:58 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:17:58 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:name>tempest-ServersNegativeTestJSON-server-365256680</nova:name>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:17:58</nova:creationTime>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:17:58 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:17:58 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:owner>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:user uuid="d83bac00dc8a40559ff4b0f0673c79a0">tempest-ServersNegativeTestJSON-308617736-project-member</nova:user>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:project uuid="12a7845e453c40d59a3fc56db2d3beb0">tempest-ServersNegativeTestJSON-308617736</nova:project>
Nov 29 13:17:58 user nova-compute[75071]:       </nova:owner>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:ports>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:port uuid="166a8bc2-c197-4ecc-a2f8-e3bbe84683e9">
Nov 29 13:17:58 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:17:58 user nova-compute[75071]:         </nova:port>
Nov 29 13:17:58 user nova-compute[75071]:       </nova:ports>
Nov 29 13:17:58 user nova-compute[75071]:     </nova:instance>
Nov 29 13:17:58 user nova-compute[75071]:   </metadata>
Nov 29 13:17:58 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:17:58 user nova-compute[75071]:     <system>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="serial">945db3bb-5653-48f8-9c5f-2be1984e3cd2</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="uuid">945db3bb-5653-48f8-9c5f-2be1984e3cd2</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:17:58 user nova-compute[75071]:     </system>
Nov 29 13:17:58 user nova-compute[75071]:   </sysinfo>
Nov 29 13:17:58 user nova-compute[75071]:   <os>
Nov 29 13:17:58 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:17:58 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:17:58 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:17:58 user nova-compute[75071]:   </os>
Nov 29 13:17:58 user nova-compute[75071]:   <features>
Nov 29 13:17:58 user nova-compute[75071]:     <acpi/>
Nov 29 13:17:58 user nova-compute[75071]:     <apic/>
Nov 29 13:17:58 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:17:58 user nova-compute[75071]:   </features>
Nov 29 13:17:58 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:17:58 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:17:58 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:17:58 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:17:58 user nova-compute[75071]:   </clock>
Nov 29 13:17:58 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:17:58 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:17:58 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:17:58 user nova-compute[75071]:   </cpu>
Nov 29 13:17:58 user nova-compute[75071]:   <devices>
Nov 29 13:17:58 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:17:58 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:17:58 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk"/>
Nov 29 13:17:58 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:17:58 user nova-compute[75071]:     </disk>
Nov 29 13:17:58 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:17:58 user nova-compute[75071]:       <mac address="fa:16:3e:ad:e6:d3"/>
Nov 29 13:17:58 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:17:58 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:17:58 user nova-compute[75071]:       <target dev="tap166a8bc2-c1"/>
Nov 29 13:17:58 user nova-compute[75071]:     </interface>
Nov 29 13:17:58 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:17:58 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/console.log" append="off"/>
Nov 29 13:17:58 user nova-compute[75071]:     </serial>
Nov 29 13:17:58 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:17:58 user nova-compute[75071]:     <video>
Nov 29 13:17:58 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:17:58 user nova-compute[75071]:     </video>
Nov 29 13:17:58 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:17:58 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:17:58 user nova-compute[75071]:     </rng>
Nov 29 13:17:58 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:17:58 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:17:58 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:17:58 user nova-compute[75071]:     </memballoon>
Nov 29 13:17:58 user nova-compute[75071]:   </devices>
Nov 29 13:17:58 user nova-compute[75071]: </domain>
Nov 29 13:17:58 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-365256680',display_name='tempest-ServersNegativeTestJSON-server-365256680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-365256680',id=1,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a7845e453c40d59a3fc56db2d3beb0',ramdisk_id='',reservation_id='r-ayba00sx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-308617736',owner_user_name='tempest-ServersNegativeTestJSON-308617736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:17:49Z,user_data=None,user_id='d83bac00dc8a40559ff4b0f0673c79a0',uuid=945db3bb-5653-48f8-9c5f-2be1984e3cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converting VIF {"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:e6:d3,bridge_name='br-int',has_traffic_filtering=True,id=166a8bc2-c197-4ecc-a2f8-e3bbe84683e9,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a8bc2-c1') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG os_vif [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:e6:d3,bridge_name='br-int',has_traffic_filtering=True,id=166a8bc2-c197-4ecc-a2f8-e3bbe84683e9,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a8bc2-c1') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Instance network_info: |[{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Created schema index Interface.name {{(pid=75071) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Created schema index Port.name {{(pid=75071) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Created schema index Bridge.name {{(pid=75071) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Refreshing network info cache for port c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Start _get_guest_xml network_info=[{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [POLLOUT] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88c4c83d-ef3a-5387-9f75-2461bffd619f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:17:58 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmphj0xagdl/privsep.sock']
Nov 29 13:17:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:17:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:17:58 user sudo[84366]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmphj0xagdl/privsep.sock
Nov 29 13:17:58 user sudo[84366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1302070337',display_name='tempest-ServerActionsTestOtherA-server-1302070337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1302070337',id=2,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dkzredzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=64806dd7-0adb-4bb2-954a-707928115ce9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:c4:63,bridge_name='br-int',has_traffic_filtering=True,id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e3d926-2c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'pci_devices' on Instance uuid 64806dd7-0adb-4bb2-954a-707928115ce9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:17:58 user nova-compute[75071]:   <uuid>64806dd7-0adb-4bb2-954a-707928115ce9</uuid>
Nov 29 13:17:58 user nova-compute[75071]:   <name>instance-00000002</name>
Nov 29 13:17:58 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:17:58 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:17:58 user nova-compute[75071]:   <metadata>
Nov 29 13:17:58 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:17:58 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-1302070337</nova:name>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:17:58</nova:creationTime>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:17:58 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:17:58 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:owner>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:user uuid="8395b32f70af4fd782ad81a609e9f63a">tempest-ServerActionsTestOtherA-611751521-project-member</nova:user>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:project uuid="36f5f5e7553949989e7fc90db828a0bd">tempest-ServerActionsTestOtherA-611751521</nova:project>
Nov 29 13:17:58 user nova-compute[75071]:       </nova:owner>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:17:58 user nova-compute[75071]:       <nova:ports>
Nov 29 13:17:58 user nova-compute[75071]:         <nova:port uuid="c4e3d926-2ca7-42cc-9a76-5bc4db72803e">
Nov 29 13:17:58 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:17:58 user nova-compute[75071]:         </nova:port>
Nov 29 13:17:58 user nova-compute[75071]:       </nova:ports>
Nov 29 13:17:58 user nova-compute[75071]:     </nova:instance>
Nov 29 13:17:58 user nova-compute[75071]:   </metadata>
Nov 29 13:17:58 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:17:58 user nova-compute[75071]:     <system>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="serial">64806dd7-0adb-4bb2-954a-707928115ce9</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="uuid">64806dd7-0adb-4bb2-954a-707928115ce9</entry>
Nov 29 13:17:58 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:17:58 user nova-compute[75071]:     </system>
Nov 29 13:17:58 user nova-compute[75071]:   </sysinfo>
Nov 29 13:17:58 user nova-compute[75071]:   <os>
Nov 29 13:17:58 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:17:58 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:17:58 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:17:58 user nova-compute[75071]:   </os>
Nov 29 13:17:58 user nova-compute[75071]:   <features>
Nov 29 13:17:58 user nova-compute[75071]:     <acpi/>
Nov 29 13:17:58 user nova-compute[75071]:     <apic/>
Nov 29 13:17:58 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:17:58 user nova-compute[75071]:   </features>
Nov 29 13:17:58 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:17:58 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:17:58 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:17:58 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:17:58 user nova-compute[75071]:   </clock>
Nov 29 13:17:58 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:17:58 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:17:58 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:17:58 user nova-compute[75071]:   </cpu>
Nov 29 13:17:58 user nova-compute[75071]:   <devices>
Nov 29 13:17:58 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:17:58 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:17:58 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk"/>
Nov 29 13:17:58 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:17:58 user nova-compute[75071]:     </disk>
Nov 29 13:17:58 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:17:58 user nova-compute[75071]:       <mac address="fa:16:3e:67:c4:63"/>
Nov 29 13:17:58 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:17:58 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:17:58 user nova-compute[75071]:       <target dev="tapc4e3d926-2c"/>
Nov 29 13:17:58 user nova-compute[75071]:     </interface>
Nov 29 13:17:58 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:17:58 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/console.log" append="off"/>
Nov 29 13:17:58 user nova-compute[75071]:     </serial>
Nov 29 13:17:58 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:17:58 user nova-compute[75071]:     <video>
Nov 29 13:17:58 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:17:58 user nova-compute[75071]:     </video>
Nov 29 13:17:58 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:17:58 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:17:58 user nova-compute[75071]:     </rng>
Nov 29 13:17:58 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:17:58 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:17:58 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:17:58 user nova-compute[75071]:     </memballoon>
Nov 29 13:17:58 user nova-compute[75071]:   </devices>
Nov 29 13:17:58 user nova-compute[75071]: </domain>
Nov 29 13:17:58 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1302070337',display_name='tempest-ServerActionsTestOtherA-server-1302070337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1302070337',id=2,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dkzredzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=64806dd7-0adb-4bb2-954a-707928115ce9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:c4:63,bridge_name='br-int',has_traffic_filtering=True,id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e3d926-2c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG os_vif [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:c4:63,bridge_name='br-int',has_traffic_filtering=True,id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e3d926-2c') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0323b502-c1ad-5b10-a136-a3c134e03bb7', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updated VIF entry in instance network info cache for port 166a8bc2-c197-4ecc-a2f8-e3bbe84683e9. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updating instance_info_cache with network_info: [{"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49034de5-220e-454d-9d8a-3dab58535481 req-6081a5e7-74bb-4bab-84bb-6ece63d067d5 service nova] Releasing lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updated VIF entry in instance network info cache for port c4e3d926-2ca7-42cc-9a76-5bc4db72803e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d539827d-30ad-4140-9a3b-7b6c3a261f36 req-c8e4f149-7bfe-4517-a53a-4d6c85143b0c service nova] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:17:59 user sudo[84366]: pam_unix(sudo:session): session closed for user root
Nov 29 13:17:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:17:59 user nova-compute[75071]: INFO nova.compute.claims [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Claim successful on node user
Nov 29 13:17:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:17:59 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Spawned new privsep daemon via rootwrap
Nov 29 13:17:59 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 13:17:59 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 13:17:59 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 13:17:59 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84375
Nov 29 13:18:00 user nova-compute[75071]: WARNING oslo_privsep.priv_context [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] privsep daemon already running
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4e3d926-2c, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4e3d926-2c, col_values=(('qos', UUID('bc73df4d-813a-42c7-b8df-dbe6422eb37b')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4e3d926-2c, col_values=(('external_ids', {'iface-id': 'c4e3d926-2ca7-42cc-9a76-5bc4db72803e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:c4:63', 'vm-uuid': '64806dd7-0adb-4bb2-954a-707928115ce9'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:00 user nova-compute[75071]: INFO os_vif [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:c4:63,bridge_name='br-int',has_traffic_filtering=True,id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e3d926-2c')
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap166a8bc2-c1, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap166a8bc2-c1, col_values=(('qos', UUID('62bd8f81-96b2-4793-a430-656fedd6da8f')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap166a8bc2-c1, col_values=(('external_ids', {'iface-id': '166a8bc2-c197-4ecc-a2f8-e3bbe84683e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:e6:d3', 'vm-uuid': '945db3bb-5653-48f8-9c5f-2be1984e3cd2'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.627s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:18:00 user nova-compute[75071]: INFO nova.compute.claims [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Claim successful on node user
Nov 29 13:18:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:00 user nova-compute[75071]: INFO os_vif [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:e6:d3,bridge_name='br-int',has_traffic_filtering=True,id=166a8bc2-c197-4ecc-a2f8-e3bbe84683e9,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a8bc2-c1')
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] No VIF found with MAC fa:16:3e:ad:e6:d3, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No VIF found with MAC fa:16:3e:67:c4:63, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:18:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Creating image(s)
Nov 29 13:18:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:00 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.policy [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f196295464214feb8986122fa9fca139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77e1870fa1242049bc58bcdd5a91376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:18:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk 1073741824" returned: 0 in 0.050s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.policy [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41649c13883b4d01a13a22c529f9bc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42978586ae934e319e9848de833d9877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:18:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Creating image(s)
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.237s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.254s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Cannot resize image /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Ensure instance console log exists: /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk 1073741824" returned: 0 in 0.042s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Cannot resize image /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Ensure instance console log exists: /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Successfully created port: 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:18:03 user nova-compute[75071]: INFO nova.compute.claims [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Claim successful on node user
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Successfully created port: 16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:18:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:18:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Creating image(s)
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "/opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "/opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "/opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG nova.policy [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44500d2105a742ddacaf6e766f042bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c2c9d59234462091e0e4548c770d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.241s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk 1073741824" returned: 0 in 0.064s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Successfully updated port: 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-changed-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Refreshing instance network info cache due to event network-changed-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Instance spawned successfully.
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Instance spawned successfully.
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.401s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Cannot resize image /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Ensure instance console log exists: /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:05 user nova-compute[75071]: INFO nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Took 13.62 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:05 user nova-compute[75071]: INFO nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Took 17.25 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:06 user nova-compute[75071]: INFO nova.compute.manager [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Took 18.88 seconds to build instance.
Nov 29 13:18:06 user nova-compute[75071]: INFO nova.compute.manager [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Took 14.59 seconds to build instance.
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9f1cb093-0a03-4c64-b413-1fc5c8e5f678 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.216s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-afa1511b-dfb5-4fcf-8eb4-52c02475e86d tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.753s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Successfully updated port: 16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance network_info: |[{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Refreshing network info cache for port 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Start _get_guest_xml network_info=[{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:18:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lazy-loading 'pci_devices' on Instance uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:18:06 user nova-compute[75071]:   <uuid>6935d835-c98f-4355-8031-4436125925f1</uuid>
Nov 29 13:18:06 user nova-compute[75071]:   <name>instance-00000003</name>
Nov 29 13:18:06 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:18:06 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:18:06 user nova-compute[75071]:   <metadata>
Nov 29 13:18:06 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:18:06 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherB-server-2016764760</nova:name>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:18:06</nova:creationTime>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:18:06 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:18:06 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:owner>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:user uuid="41649c13883b4d01a13a22c529f9bc6f">tempest-ServerActionsTestOtherB-1138605091-project-member</nova:user>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:project uuid="42978586ae934e319e9848de833d9877">tempest-ServerActionsTestOtherB-1138605091</nova:project>
Nov 29 13:18:06 user nova-compute[75071]:       </nova:owner>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:ports>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:port uuid="10d0cfed-e70a-4d6e-b80c-75e2376fc0cd">
Nov 29 13:18:06 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:18:06 user nova-compute[75071]:         </nova:port>
Nov 29 13:18:06 user nova-compute[75071]:       </nova:ports>
Nov 29 13:18:06 user nova-compute[75071]:     </nova:instance>
Nov 29 13:18:06 user nova-compute[75071]:   </metadata>
Nov 29 13:18:06 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:18:06 user nova-compute[75071]:     <system>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="serial">6935d835-c98f-4355-8031-4436125925f1</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="uuid">6935d835-c98f-4355-8031-4436125925f1</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:18:06 user nova-compute[75071]:     </system>
Nov 29 13:18:06 user nova-compute[75071]:   </sysinfo>
Nov 29 13:18:06 user nova-compute[75071]:   <os>
Nov 29 13:18:06 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:18:06 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:18:06 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:18:06 user nova-compute[75071]:   </os>
Nov 29 13:18:06 user nova-compute[75071]:   <features>
Nov 29 13:18:06 user nova-compute[75071]:     <acpi/>
Nov 29 13:18:06 user nova-compute[75071]:     <apic/>
Nov 29 13:18:06 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:18:06 user nova-compute[75071]:   </features>
Nov 29 13:18:06 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:18:06 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:18:06 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:18:06 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:18:06 user nova-compute[75071]:   </clock>
Nov 29 13:18:06 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:18:06 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:18:06 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:18:06 user nova-compute[75071]:   </cpu>
Nov 29 13:18:06 user nova-compute[75071]:   <devices>
Nov 29 13:18:06 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:18:06 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:18:06 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk"/>
Nov 29 13:18:06 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:18:06 user nova-compute[75071]:     </disk>
Nov 29 13:18:06 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:18:06 user nova-compute[75071]:       <mac address="fa:16:3e:92:79:29"/>
Nov 29 13:18:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:06 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:18:06 user nova-compute[75071]:       <target dev="tap10d0cfed-e7"/>
Nov 29 13:18:06 user nova-compute[75071]:     </interface>
Nov 29 13:18:06 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:18:06 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/console.log" append="off"/>
Nov 29 13:18:06 user nova-compute[75071]:     </serial>
Nov 29 13:18:06 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:18:06 user nova-compute[75071]:     <video>
Nov 29 13:18:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:06 user nova-compute[75071]:     </video>
Nov 29 13:18:06 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:18:06 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:18:06 user nova-compute[75071]:     </rng>
Nov 29 13:18:06 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:18:06 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:18:06 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:18:06 user nova-compute[75071]:     </memballoon>
Nov 29 13:18:06 user nova-compute[75071]:   </devices>
Nov 29 13:18:06 user nova-compute[75071]: </domain>
Nov 29 13:18:06 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG os_vif [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing instance network info cache due to event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f77593a-61a7-51c1-bca4-88476bae037b', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10d0cfed-e7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10d0cfed-e7, col_values=(('qos', UUID('f837cdfa-9851-467c-9c86-7f4d2dc19395')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10d0cfed-e7, col_values=(('external_ids', {'iface-id': '10d0cfed-e70a-4d6e-b80c-75e2376fc0cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:79:29', 'vm-uuid': '6935d835-c98f-4355-8031-4436125925f1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: INFO os_vif [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7')
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No VIF found with MAC fa:16:3e:92:79:29, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance network_info: |[{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Start _get_guest_xml network_info=[{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:18:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-984259261',display_name='tempest-ServerStableDeviceRescueTest-server-984259261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-984259261',id=4,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv956hhwxyofSbjnRV0xi2CXYQE5UqmKJmiBvc7uy5OHP1EnD8bvo08Zk4kcfLuw5dJBMKfe1b5SxaP7G0BrioQI7K2kAjL5OEBhKZIsjjhm9bfUXebdoLLCjwnfxHAow==',key_name='tempest-keypair-1727047100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c77e1870fa1242049bc58bcdd5a91376',ramdisk_id='',reservation_id='r-az0rg775',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-798793767',owner_user_name='tempest-ServerStableDeviceRescueTest-798793767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f196295464214feb8986122fa9fca139',uuid=ef8e7624-0193-4ba9-ae01-0a3a140f7a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converting VIF {"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'pci_devices' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:18:06 user nova-compute[75071]:   <uuid>ef8e7624-0193-4ba9-ae01-0a3a140f7a67</uuid>
Nov 29 13:18:06 user nova-compute[75071]:   <name>instance-00000004</name>
Nov 29 13:18:06 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:18:06 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:18:06 user nova-compute[75071]:   <metadata>
Nov 29 13:18:06 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:18:06 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-984259261</nova:name>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:18:06</nova:creationTime>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:18:06 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:18:06 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:owner>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:user uuid="f196295464214feb8986122fa9fca139">tempest-ServerStableDeviceRescueTest-798793767-project-member</nova:user>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:project uuid="c77e1870fa1242049bc58bcdd5a91376">tempest-ServerStableDeviceRescueTest-798793767</nova:project>
Nov 29 13:18:06 user nova-compute[75071]:       </nova:owner>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:18:06 user nova-compute[75071]:       <nova:ports>
Nov 29 13:18:06 user nova-compute[75071]:         <nova:port uuid="16906a3e-623e-41b2-9940-0d068b2c5625">
Nov 29 13:18:06 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:18:06 user nova-compute[75071]:         </nova:port>
Nov 29 13:18:06 user nova-compute[75071]:       </nova:ports>
Nov 29 13:18:06 user nova-compute[75071]:     </nova:instance>
Nov 29 13:18:06 user nova-compute[75071]:   </metadata>
Nov 29 13:18:06 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:18:06 user nova-compute[75071]:     <system>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="serial">ef8e7624-0193-4ba9-ae01-0a3a140f7a67</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="uuid">ef8e7624-0193-4ba9-ae01-0a3a140f7a67</entry>
Nov 29 13:18:06 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:18:06 user nova-compute[75071]:     </system>
Nov 29 13:18:06 user nova-compute[75071]:   </sysinfo>
Nov 29 13:18:06 user nova-compute[75071]:   <os>
Nov 29 13:18:06 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:18:06 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:18:06 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:18:06 user nova-compute[75071]:   </os>
Nov 29 13:18:06 user nova-compute[75071]:   <features>
Nov 29 13:18:06 user nova-compute[75071]:     <acpi/>
Nov 29 13:18:06 user nova-compute[75071]:     <apic/>
Nov 29 13:18:06 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:18:06 user nova-compute[75071]:   </features>
Nov 29 13:18:06 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:18:06 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:18:06 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:18:06 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:18:06 user nova-compute[75071]:   </clock>
Nov 29 13:18:06 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:18:06 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:18:06 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:18:06 user nova-compute[75071]:   </cpu>
Nov 29 13:18:06 user nova-compute[75071]:   <devices>
Nov 29 13:18:06 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:18:06 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:18:06 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk"/>
Nov 29 13:18:06 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:18:06 user nova-compute[75071]:     </disk>
Nov 29 13:18:06 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:18:06 user nova-compute[75071]:       <mac address="fa:16:3e:00:b2:03"/>
Nov 29 13:18:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:06 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:18:06 user nova-compute[75071]:       <target dev="tap16906a3e-62"/>
Nov 29 13:18:06 user nova-compute[75071]:     </interface>
Nov 29 13:18:06 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:18:06 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/console.log" append="off"/>
Nov 29 13:18:06 user nova-compute[75071]:     </serial>
Nov 29 13:18:06 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:18:06 user nova-compute[75071]:     <video>
Nov 29 13:18:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:06 user nova-compute[75071]:     </video>
Nov 29 13:18:06 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:18:06 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:18:06 user nova-compute[75071]:     </rng>
Nov 29 13:18:06 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:18:06 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:18:06 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:18:06 user nova-compute[75071]:     </memballoon>
Nov 29 13:18:06 user nova-compute[75071]:   </devices>
Nov 29 13:18:06 user nova-compute[75071]: </domain>
Nov 29 13:18:06 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-984259261',display_name='tempest-ServerStableDeviceRescueTest-server-984259261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-984259261',id=4,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv956hhwxyofSbjnRV0xi2CXYQE5UqmKJmiBvc7uy5OHP1EnD8bvo08Zk4kcfLuw5dJBMKfe1b5SxaP7G0BrioQI7K2kAjL5OEBhKZIsjjhm9bfUXebdoLLCjwnfxHAow==',key_name='tempest-keypair-1727047100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c77e1870fa1242049bc58bcdd5a91376',ramdisk_id='',reservation_id='r-az0rg775',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-798793767',owner_user_name='tempest-ServerStableDeviceRescueTest-798793767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f196295464214feb8986122fa9fca139',uuid=ef8e7624-0193-4ba9-ae01-0a3a140f7a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converting VIF {"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG os_vif [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca16d930-966d-50d9-b5b5-6b7efd07f719', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16906a3e-62, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16906a3e-62, col_values=(('qos', UUID('c8e35468-4a16-4ad3-bbe5-d9505e27f2a7')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16906a3e-62, col_values=(('external_ids', {'iface-id': '16906a3e-623e-41b2-9940-0d068b2c5625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:b2:03', 'vm-uuid': 'ef8e7624-0193-4ba9-ae01-0a3a140f7a67'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:06 user nova-compute[75071]: INFO os_vif [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62')
Nov 29 13:18:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No VIF found with MAC fa:16:3e:00:b2:03, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updated VIF entry in instance network info cache for port 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Successfully created port: cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f53a88e-f7d3-4b4e-9cee-691cffcd075c req-1409e3ee-357a-4587-b2da-ed18b03ff2e5 service nova] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updated VIF entry in instance network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0d50300c-6389-46df-add2-ba5478876288 req-6f0cda5d-dffe-4626-bb43-9e49702ff49b service nova] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Successfully updated port: cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquired lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-changed-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Refreshing instance network info cache due to event network-changed-cf16aa7f-bd3e-4107-850f-37bae039432d. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] Acquiring lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updating instance_info_cache with network_info: [{"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Releasing lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Instance network_info: |[{"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] Acquired lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Refreshing network info cache for port cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Start _get_guest_xml network_info=[{"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:18:10 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:10 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1007830647',display_name='tempest-VolumesAdminNegativeTest-server-1007830647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1007830647',id=5,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+LEi5qfq4YrHJ+PYJQ+dwUUlnkNDODawaledfmjtPqxl4XU3QhWGLBG7fLBRUTnshPNfK+aanBgiuYpcu+OcSoJw8FE2qIi2Jv3q4kmvhNBjXuNHx5Y9WQzmvGn8zGrA==',key_name='tempest-keypair-458538850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c2c9d59234462091e0e4548c770d12',ramdisk_id='',reservation_id='r-34600hat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-984213226',owner_user_name='tempest-VolumesAdminNegativeTest-984213226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44500d2105a742ddacaf6e766f042bf2',uuid=014f79bb-e808-49e1-8d7a-c058b99c8377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converting VIF {"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:16,bridge_name='br-int',has_traffic_filtering=True,id=cf16aa7f-bd3e-4107-850f-37bae039432d,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf16aa7f-bd') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lazy-loading 'pci_devices' on Instance uuid 014f79bb-e808-49e1-8d7a-c058b99c8377 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1bb4df4-0a33-450c-8d18-3fbf70c2b095 req-60e4d7a7-205a-4195-9ed6-717345c101b0 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received event network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1bb4df4-0a33-450c-8d18-3fbf70c2b095 req-60e4d7a7-205a-4195-9ed6-717345c101b0 service nova] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1bb4df4-0a33-450c-8d18-3fbf70c2b095 req-60e4d7a7-205a-4195-9ed6-717345c101b0 service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1bb4df4-0a33-450c-8d18-3fbf70c2b095 req-60e4d7a7-205a-4195-9ed6-717345c101b0 service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1bb4df4-0a33-450c-8d18-3fbf70c2b095 req-60e4d7a7-205a-4195-9ed6-717345c101b0 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] No waiting events found dispatching network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:10 user nova-compute[75071]: WARNING nova.compute.manager [req-b1bb4df4-0a33-450c-8d18-3fbf70c2b095 req-60e4d7a7-205a-4195-9ed6-717345c101b0 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received unexpected event network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 for instance with vm_state active and task_state None.
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:18:10 user nova-compute[75071]:   <uuid>014f79bb-e808-49e1-8d7a-c058b99c8377</uuid>
Nov 29 13:18:10 user nova-compute[75071]:   <name>instance-00000005</name>
Nov 29 13:18:10 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:18:10 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:18:10 user nova-compute[75071]:   <metadata>
Nov 29 13:18:10 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:18:10 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:18:10 user nova-compute[75071]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1007830647</nova:name>
Nov 29 13:18:10 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:18:10</nova:creationTime>
Nov 29 13:18:10 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:18:10 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:18:10 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:18:10 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:18:10 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:18:10 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:18:10 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:18:10 user nova-compute[75071]:       <nova:owner>
Nov 29 13:18:10 user nova-compute[75071]:         <nova:user uuid="44500d2105a742ddacaf6e766f042bf2">tempest-VolumesAdminNegativeTest-984213226-project-member</nova:user>
Nov 29 13:18:10 user nova-compute[75071]:         <nova:project uuid="f5c2c9d59234462091e0e4548c770d12">tempest-VolumesAdminNegativeTest-984213226</nova:project>
Nov 29 13:18:10 user nova-compute[75071]:       </nova:owner>
Nov 29 13:18:10 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:18:10 user nova-compute[75071]:       <nova:ports>
Nov 29 13:18:10 user nova-compute[75071]:         <nova:port uuid="cf16aa7f-bd3e-4107-850f-37bae039432d">
Nov 29 13:18:10 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:18:10 user nova-compute[75071]:         </nova:port>
Nov 29 13:18:10 user nova-compute[75071]:       </nova:ports>
Nov 29 13:18:10 user nova-compute[75071]:     </nova:instance>
Nov 29 13:18:10 user nova-compute[75071]:   </metadata>
Nov 29 13:18:10 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:18:10 user nova-compute[75071]:     <system>
Nov 29 13:18:10 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:18:10 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:18:10 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:18:10 user nova-compute[75071]:       <entry name="serial">014f79bb-e808-49e1-8d7a-c058b99c8377</entry>
Nov 29 13:18:10 user nova-compute[75071]:       <entry name="uuid">014f79bb-e808-49e1-8d7a-c058b99c8377</entry>
Nov 29 13:18:10 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:18:10 user nova-compute[75071]:     </system>
Nov 29 13:18:10 user nova-compute[75071]:   </sysinfo>
Nov 29 13:18:10 user nova-compute[75071]:   <os>
Nov 29 13:18:10 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:18:10 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:18:10 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:18:10 user nova-compute[75071]:   </os>
Nov 29 13:18:10 user nova-compute[75071]:   <features>
Nov 29 13:18:10 user nova-compute[75071]:     <acpi/>
Nov 29 13:18:10 user nova-compute[75071]:     <apic/>
Nov 29 13:18:10 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:18:10 user nova-compute[75071]:   </features>
Nov 29 13:18:10 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:18:10 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:18:10 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:18:10 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:18:10 user nova-compute[75071]:   </clock>
Nov 29 13:18:10 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:18:10 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:18:10 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:18:10 user nova-compute[75071]:   </cpu>
Nov 29 13:18:10 user nova-compute[75071]:   <devices>
Nov 29 13:18:10 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:18:10 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:18:10 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk"/>
Nov 29 13:18:10 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:18:10 user nova-compute[75071]:     </disk>
Nov 29 13:18:10 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:18:10 user nova-compute[75071]:       <mac address="fa:16:3e:20:58:16"/>
Nov 29 13:18:10 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:10 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:18:10 user nova-compute[75071]:       <target dev="tapcf16aa7f-bd"/>
Nov 29 13:18:10 user nova-compute[75071]:     </interface>
Nov 29 13:18:10 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:18:10 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/console.log" append="off"/>
Nov 29 13:18:10 user nova-compute[75071]:     </serial>
Nov 29 13:18:10 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:18:10 user nova-compute[75071]:     <video>
Nov 29 13:18:10 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:10 user nova-compute[75071]:     </video>
Nov 29 13:18:10 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:18:10 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:18:10 user nova-compute[75071]:     </rng>
Nov 29 13:18:10 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:18:10 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:18:10 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:18:10 user nova-compute[75071]:     </memballoon>
Nov 29 13:18:10 user nova-compute[75071]:   </devices>
Nov 29 13:18:10 user nova-compute[75071]: </domain>
Nov 29 13:18:10 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1007830647',display_name='tempest-VolumesAdminNegativeTest-server-1007830647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1007830647',id=5,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+LEi5qfq4YrHJ+PYJQ+dwUUlnkNDODawaledfmjtPqxl4XU3QhWGLBG7fLBRUTnshPNfK+aanBgiuYpcu+OcSoJw8FE2qIi2Jv3q4kmvhNBjXuNHx5Y9WQzmvGn8zGrA==',key_name='tempest-keypair-458538850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c2c9d59234462091e0e4548c770d12',ramdisk_id='',reservation_id='r-34600hat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-984213226',owner_user_name='tempest-VolumesAdminNegativeTest-984213226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44500d2105a742ddacaf6e766f042bf2',uuid=014f79bb-e808-49e1-8d7a-c058b99c8377,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converting VIF {"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:16,bridge_name='br-int',has_traffic_filtering=True,id=cf16aa7f-bd3e-4107-850f-37bae039432d,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf16aa7f-bd') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG os_vif [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:16,bridge_name='br-int',has_traffic_filtering=True,id=cf16aa7f-bd3e-4107-850f-37bae039432d,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf16aa7f-bd') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97f94c52-60bb-57f6-894b-542c49f81ded', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf16aa7f-bd, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf16aa7f-bd, col_values=(('qos', UUID('e968f760-edcd-4e91-b89f-fcc67be8afe8')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf16aa7f-bd, col_values=(('external_ids', {'iface-id': 'cf16aa7f-bd3e-4107-850f-37bae039432d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:58:16', 'vm-uuid': '014f79bb-e808-49e1-8d7a-c058b99c8377'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:10 user nova-compute[75071]: INFO os_vif [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:58:16,bridge_name='br-int',has_traffic_filtering=True,id=cf16aa7f-bd3e-4107-850f-37bae039432d,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf16aa7f-bd')
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] No VIF found with MAC fa:16:3e:20:58:16, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updated VIF entry in instance network info cache for port cf16aa7f-bd3e-4107-850f-37bae039432d. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updating instance_info_cache with network_info: [{"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-31413579-c637-4822-b757-c3999bb31991 req-4ecb3cd0-d05e-4cec-904a-419b9f4d33c3 service nova] Releasing lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:18:12 user nova-compute[75071]: INFO nova.compute.claims [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Claim successful on node user
Nov 29 13:18:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-8e4b8eea-5b71-4fe2-96cb-e047e4146326 req-675e5ede-31b5-4622-a7c3-3cfc61c778e0 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received event network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8e4b8eea-5b71-4fe2-96cb-e047e4146326 req-675e5ede-31b5-4622-a7c3-3cfc61c778e0 service nova] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8e4b8eea-5b71-4fe2-96cb-e047e4146326 req-675e5ede-31b5-4622-a7c3-3cfc61c778e0 service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8e4b8eea-5b71-4fe2-96cb-e047e4146326 req-675e5ede-31b5-4622-a7c3-3cfc61c778e0 service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-8e4b8eea-5b71-4fe2-96cb-e047e4146326 req-675e5ede-31b5-4622-a7c3-3cfc61c778e0 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] No waiting events found dispatching network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:12 user nova-compute[75071]: WARNING nova.compute.manager [req-8e4b8eea-5b71-4fe2-96cb-e047e4146326 req-675e5ede-31b5-4622-a7c3-3cfc61c778e0 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received unexpected event network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 for instance with vm_state active and task_state None.
Nov 29 13:18:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.808s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:18:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.policy [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2620d9a6cc1b4f789bdb2cb0827fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd794844d6bd7438dba426da0c83eea2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:18:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Creating image(s)
Nov 29 13:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.501s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.273s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk 1073741824" returned: 0 in 0.089s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.382s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.313s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Cannot resize image /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Ensure instance console log exists: /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance spawned successfully.
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Successfully created port: 254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:18:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance spawned successfully.
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:15 user nova-compute[75071]: INFO nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Took 14.99 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:15 user nova-compute[75071]: INFO nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Took 14.46 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:16 user nova-compute[75071]: INFO nova.compute.manager [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Took 16.22 seconds to build instance.
Nov 29 13:18:16 user nova-compute[75071]: INFO nova.compute.manager [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Took 16.29 seconds to build instance.
Nov 29 13:18:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-245d1b04-4040-4dc1-a6a6-69229b34f2ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.529s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0a5fc7a-4f40-43a9-93a5-d4a54ca3d4ff tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.514s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Instance spawned successfully.
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:16 user nova-compute[75071]: INFO nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Took 11.63 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:16 user nova-compute[75071]: INFO nova.compute.manager [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Took 12.87 seconds to build instance.
Nov 29 13:18:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5373544d-2c29-425d-afaf-d350bd4cf426 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-a66f10d6-4619-4059-962f-bcce72617ba2 req-32d56c83-710b-41b9-b668-0cbeba611348 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a66f10d6-4619-4059-962f-bcce72617ba2 req-32d56c83-710b-41b9-b668-0cbeba611348 service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a66f10d6-4619-4059-962f-bcce72617ba2 req-32d56c83-710b-41b9-b668-0cbeba611348 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a66f10d6-4619-4059-962f-bcce72617ba2 req-32d56c83-710b-41b9-b668-0cbeba611348 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-a66f10d6-4619-4059-962f-bcce72617ba2 req-32d56c83-710b-41b9-b668-0cbeba611348 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:17 user nova-compute[75071]: WARNING nova.compute.manager [req-a66f10d6-4619-4059-962f-bcce72617ba2 req-32d56c83-710b-41b9-b668-0cbeba611348 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state active and task_state None.
Nov 29 13:18:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-15ddba85-c686-4ebd-b1b4-3dd2a1dd3162 req-cc1858a5-f9f4-4ac7-8c9e-a75b34e07f78 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15ddba85-c686-4ebd-b1b4-3dd2a1dd3162 req-cc1858a5-f9f4-4ac7-8c9e-a75b34e07f78 service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15ddba85-c686-4ebd-b1b4-3dd2a1dd3162 req-cc1858a5-f9f4-4ac7-8c9e-a75b34e07f78 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15ddba85-c686-4ebd-b1b4-3dd2a1dd3162 req-cc1858a5-f9f4-4ac7-8c9e-a75b34e07f78 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-15ddba85-c686-4ebd-b1b4-3dd2a1dd3162 req-cc1858a5-f9f4-4ac7-8c9e-a75b34e07f78 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:17 user nova-compute[75071]: WARNING nova.compute.manager [req-15ddba85-c686-4ebd-b1b4-3dd2a1dd3162 req-cc1858a5-f9f4-4ac7-8c9e-a75b34e07f78 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state active and task_state None.
Nov 29 13:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Successfully updated port: 254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquired lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-changed-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Refreshing instance network info cache due to event network-changed-254915cd-7b23-4208-a5bf-af1133dc3493. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] Acquiring lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:18:18 user nova-compute[75071]: INFO nova.compute.claims [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Claim successful on node user
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Releasing lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Instance network_info: |[{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] Acquired lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Refreshing network info cache for port 254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Start _get_guest_xml network_info=[{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:18:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converting VIF {"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c5:4a,bridge_name='br-int',has_traffic_filtering=True,id=254915cd-7b23-4208-a5bf-af1133dc3493,network=Network(1ed47474-7d3b-43a0-8f30-804fffb270a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254915cd-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:19 user nova-compute[75071]: WARNING nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state active and task_state None.
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] No waiting events found dispatching network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:19 user nova-compute[75071]: WARNING nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received unexpected event network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d for instance with vm_state active and task_state None.
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] No waiting events found dispatching network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:19 user nova-compute[75071]: WARNING nova.compute.manager [req-f74da421-e522-41c5-8d95-a6ed648768eb req-589ed1f5-5f05-4fec-91e7-fe637922243a service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received unexpected event network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d for instance with vm_state active and task_state None.
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:18:19 user nova-compute[75071]:   <uuid>2a30460f-0839-4256-a3b8-0c6e170fbe4b</uuid>
Nov 29 13:18:19 user nova-compute[75071]:   <name>instance-00000006</name>
Nov 29 13:18:19 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:18:19 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:18:19 user nova-compute[75071]:   <metadata>
Nov 29 13:18:19 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:18:19 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:18:19 user nova-compute[75071]:       <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:18:19 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:18:19</nova:creationTime>
Nov 29 13:18:19 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:18:19 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:18:19 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:18:19 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:18:19 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:18:19 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:18:19 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:18:19 user nova-compute[75071]:       <nova:owner>
Nov 29 13:18:19 user nova-compute[75071]:         <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:18:19 user nova-compute[75071]:         <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:18:19 user nova-compute[75071]:       </nova:owner>
Nov 29 13:18:19 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:18:19 user nova-compute[75071]:       <nova:ports>
Nov 29 13:18:19 user nova-compute[75071]:         <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:18:19 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:18:19 user nova-compute[75071]:         </nova:port>
Nov 29 13:18:19 user nova-compute[75071]:       </nova:ports>
Nov 29 13:18:19 user nova-compute[75071]:     </nova:instance>
Nov 29 13:18:19 user nova-compute[75071]:   </metadata>
Nov 29 13:18:19 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:18:19 user nova-compute[75071]:     <system>
Nov 29 13:18:19 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:18:19 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:18:19 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:18:19 user nova-compute[75071]:       <entry name="serial">2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:18:19 user nova-compute[75071]:       <entry name="uuid">2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:18:19 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:18:19 user nova-compute[75071]:     </system>
Nov 29 13:18:19 user nova-compute[75071]:   </sysinfo>
Nov 29 13:18:19 user nova-compute[75071]:   <os>
Nov 29 13:18:19 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:18:19 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:18:19 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:18:19 user nova-compute[75071]:   </os>
Nov 29 13:18:19 user nova-compute[75071]:   <features>
Nov 29 13:18:19 user nova-compute[75071]:     <acpi/>
Nov 29 13:18:19 user nova-compute[75071]:     <apic/>
Nov 29 13:18:19 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:18:19 user nova-compute[75071]:   </features>
Nov 29 13:18:19 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:18:19 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:18:19 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:18:19 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:18:19 user nova-compute[75071]:   </clock>
Nov 29 13:18:19 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:18:19 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:18:19 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:18:19 user nova-compute[75071]:   </cpu>
Nov 29 13:18:19 user nova-compute[75071]:   <devices>
Nov 29 13:18:19 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:18:19 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:18:19 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk"/>
Nov 29 13:18:19 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:18:19 user nova-compute[75071]:     </disk>
Nov 29 13:18:19 user nova-compute[75071]:     <disk type="file" device="cdrom">
Nov 29 13:18:19 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 13:18:19 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config"/>
Nov 29 13:18:19 user nova-compute[75071]:       <target dev="hda" bus="ide"/>
Nov 29 13:18:19 user nova-compute[75071]:     </disk>
Nov 29 13:18:19 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:18:19 user nova-compute[75071]:       <mac address="fa:16:3e:8f:c5:4a"/>
Nov 29 13:18:19 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:19 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:18:19 user nova-compute[75071]:       <target dev="tap254915cd-7b"/>
Nov 29 13:18:19 user nova-compute[75071]:     </interface>
Nov 29 13:18:19 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:18:19 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log" append="off"/>
Nov 29 13:18:19 user nova-compute[75071]:     </serial>
Nov 29 13:18:19 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:18:19 user nova-compute[75071]:     <video>
Nov 29 13:18:19 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:19 user nova-compute[75071]:     </video>
Nov 29 13:18:19 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:18:19 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:18:19 user nova-compute[75071]:     </rng>
Nov 29 13:18:19 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:18:19 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:18:19 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:18:19 user nova-compute[75071]:     </memballoon>
Nov 29 13:18:19 user nova-compute[75071]:   </devices>
Nov 29 13:18:19 user nova-compute[75071]: </domain>
Nov 29 13:18:19 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converting VIF {"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c5:4a,bridge_name='br-int',has_traffic_filtering=True,id=254915cd-7b23-4208-a5bf-af1133dc3493,network=Network(1ed47474-7d3b-43a0-8f30-804fffb270a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254915cd-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG os_vif [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c5:4a,bridge_name='br-int',has_traffic_filtering=True,id=254915cd-7b23-4208-a5bf-af1133dc3493,network=Network(1ed47474-7d3b-43a0-8f30-804fffb270a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254915cd-7b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97111db0-b4b7-5271-9f22-96bc7f5d7285', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254915cd-7b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap254915cd-7b, col_values=(('qos', UUID('16ef8114-2fa6-4e02-9a3b-761c0714d4de')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap254915cd-7b, col_values=(('external_ids', {'iface-id': '254915cd-7b23-4208-a5bf-af1133dc3493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:c5:4a', 'vm-uuid': '2a30460f-0839-4256-a3b8-0c6e170fbe4b'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:19 user nova-compute[75071]: INFO os_vif [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c5:4a,bridge_name='br-int',has_traffic_filtering=True,id=254915cd-7b23-4208-a5bf-af1133dc3493,network=Network(1ed47474-7d3b-43a0-8f30-804fffb270a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254915cd-7b')
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No VIF found with MAC fa:16:3e:8f:c5:4a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Using config drive
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-279d07a5-9630-4afd-9b95-95c5c10b2f95 req-6f790650-e90a-4fe6-81a7-f450286997be service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-279d07a5-9630-4afd-9b95-95c5c10b2f95 req-6f790650-e90a-4fe6-81a7-f450286997be service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-279d07a5-9630-4afd-9b95-95c5c10b2f95 req-6f790650-e90a-4fe6-81a7-f450286997be service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-279d07a5-9630-4afd-9b95-95c5c10b2f95 req-6f790650-e90a-4fe6-81a7-f450286997be service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-279d07a5-9630-4afd-9b95-95c5c10b2f95 req-6f790650-e90a-4fe6-81a7-f450286997be service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:19 user nova-compute[75071]: WARNING nova.compute.manager [req-279d07a5-9630-4afd-9b95-95c5c10b2f95 req-6f790650-e90a-4fe6-81a7-f450286997be service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state active and task_state None.
Nov 29 13:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.233s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:18:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:18:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG nova.policy [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e07fd91c5184066b47081801acfa583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fecee9fee7f421cbc31c6f7516e70bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:18:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Creating image(s)
Nov 29 13:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "/opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "/opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "/opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Creating config drive at /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config
Nov 29 13:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp48rnfkdb {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updated VIF entry in instance network info cache for port 254915cd-7b23-4208-a5bf-af1133dc3493. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.439s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp48rnfkdb" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-28bc0eb7-636d-45dd-8433-c64d3a8c4dd4 req-e092d1b4-7f63-4938-9cd6-03b3bd9fe571 service nova] Releasing lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.292s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk 1073741824" returned: 0 in 0.068s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Successfully created port: c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.478s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:18:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Cannot resize image /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Ensure instance console log exists: /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Successfully updated port: c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquired lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-changed-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Refreshing instance network info cache due to event network-changed-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] Acquiring lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updating instance_info_cache with network_info: [{"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Releasing lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Instance network_info: |[{"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] Acquired lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Refreshing network info cache for port c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Start _get_guest_xml network_info=[{"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:18:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-106103599',display_name='tempest-TestVolumeSwap-server-106103599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-106103599',id=7,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF+qoEkIsAIWPpe2Qm4etH1BWoFZWwXWVIJLzw5UzZ62LlKN6Eakai2q5Z7pdCV2uVFKSv8/iosc/e+m7/QbX8NjrccrwxSI4veM9mRNgzQb9BRpKbhs9kW5dyaYQsr8A==',key_name='tempest-keypair-578077132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fecee9fee7f421cbc31c6f7516e70bf',ramdisk_id='',reservation_id='r-198935b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-758044431',owner_user_name='tempest-TestVolumeSwap-758044431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e07fd91c5184066b47081801acfa583',uuid=5664a867-ffa0-4aae-9794-ee14a7d91e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Converting VIF {"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:96:a8,bridge_name='br-int',has_traffic_filtering=True,id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4,network=Network(d131dd97-13f1-445c-af46-7c9c7e3527b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9ea24-ad') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lazy-loading 'pci_devices' on Instance uuid 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:18:24 user nova-compute[75071]:   <uuid>5664a867-ffa0-4aae-9794-ee14a7d91e5e</uuid>
Nov 29 13:18:24 user nova-compute[75071]:   <name>instance-00000007</name>
Nov 29 13:18:24 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:18:24 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:18:24 user nova-compute[75071]:   <metadata>
Nov 29 13:18:24 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:18:24 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:18:24 user nova-compute[75071]:       <nova:name>tempest-TestVolumeSwap-server-106103599</nova:name>
Nov 29 13:18:24 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:18:23</nova:creationTime>
Nov 29 13:18:24 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:18:24 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:18:24 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:18:24 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:18:24 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:18:24 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:18:24 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:18:24 user nova-compute[75071]:       <nova:owner>
Nov 29 13:18:24 user nova-compute[75071]:         <nova:user uuid="3e07fd91c5184066b47081801acfa583">tempest-TestVolumeSwap-758044431-project-member</nova:user>
Nov 29 13:18:24 user nova-compute[75071]:         <nova:project uuid="2fecee9fee7f421cbc31c6f7516e70bf">tempest-TestVolumeSwap-758044431</nova:project>
Nov 29 13:18:24 user nova-compute[75071]:       </nova:owner>
Nov 29 13:18:24 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:18:24 user nova-compute[75071]:       <nova:ports>
Nov 29 13:18:24 user nova-compute[75071]:         <nova:port uuid="c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4">
Nov 29 13:18:24 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 13:18:24 user nova-compute[75071]:         </nova:port>
Nov 29 13:18:24 user nova-compute[75071]:       </nova:ports>
Nov 29 13:18:24 user nova-compute[75071]:     </nova:instance>
Nov 29 13:18:24 user nova-compute[75071]:   </metadata>
Nov 29 13:18:24 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:18:24 user nova-compute[75071]:     <system>
Nov 29 13:18:24 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:18:24 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:18:24 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:18:24 user nova-compute[75071]:       <entry name="serial">5664a867-ffa0-4aae-9794-ee14a7d91e5e</entry>
Nov 29 13:18:24 user nova-compute[75071]:       <entry name="uuid">5664a867-ffa0-4aae-9794-ee14a7d91e5e</entry>
Nov 29 13:18:24 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:18:24 user nova-compute[75071]:     </system>
Nov 29 13:18:24 user nova-compute[75071]:   </sysinfo>
Nov 29 13:18:24 user nova-compute[75071]:   <os>
Nov 29 13:18:24 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:18:24 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:18:24 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:18:24 user nova-compute[75071]:   </os>
Nov 29 13:18:24 user nova-compute[75071]:   <features>
Nov 29 13:18:24 user nova-compute[75071]:     <acpi/>
Nov 29 13:18:24 user nova-compute[75071]:     <apic/>
Nov 29 13:18:24 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:18:24 user nova-compute[75071]:   </features>
Nov 29 13:18:24 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:18:24 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:18:24 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:18:24 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:18:24 user nova-compute[75071]:   </clock>
Nov 29 13:18:24 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:18:24 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:18:24 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:18:24 user nova-compute[75071]:   </cpu>
Nov 29 13:18:24 user nova-compute[75071]:   <devices>
Nov 29 13:18:24 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:18:24 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:18:24 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk"/>
Nov 29 13:18:24 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:18:24 user nova-compute[75071]:     </disk>
Nov 29 13:18:24 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:18:24 user nova-compute[75071]:       <mac address="fa:16:3e:20:96:a8"/>
Nov 29 13:18:24 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:24 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:18:24 user nova-compute[75071]:       <target dev="tapc3e9ea24-ad"/>
Nov 29 13:18:24 user nova-compute[75071]:     </interface>
Nov 29 13:18:24 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:18:24 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/console.log" append="off"/>
Nov 29 13:18:24 user nova-compute[75071]:     </serial>
Nov 29 13:18:24 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:18:24 user nova-compute[75071]:     <video>
Nov 29 13:18:24 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:24 user nova-compute[75071]:     </video>
Nov 29 13:18:24 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:18:24 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:18:24 user nova-compute[75071]:     </rng>
Nov 29 13:18:24 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:18:24 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:18:24 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:18:24 user nova-compute[75071]:     </memballoon>
Nov 29 13:18:24 user nova-compute[75071]:   </devices>
Nov 29 13:18:24 user nova-compute[75071]: </domain>
Nov 29 13:18:24 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-106103599',display_name='tempest-TestVolumeSwap-server-106103599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-106103599',id=7,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF+qoEkIsAIWPpe2Qm4etH1BWoFZWwXWVIJLzw5UzZ62LlKN6Eakai2q5Z7pdCV2uVFKSv8/iosc/e+m7/QbX8NjrccrwxSI4veM9mRNgzQb9BRpKbhs9kW5dyaYQsr8A==',key_name='tempest-keypair-578077132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fecee9fee7f421cbc31c6f7516e70bf',ramdisk_id='',reservation_id='r-198935b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-758044431',owner_user_name='tempest-TestVolumeSwap-758044431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e07fd91c5184066b47081801acfa583',uuid=5664a867-ffa0-4aae-9794-ee14a7d91e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Converting VIF {"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:96:a8,bridge_name='br-int',has_traffic_filtering=True,id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4,network=Network(d131dd97-13f1-445c-af46-7c9c7e3527b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9ea24-ad') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG os_vif [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:96:a8,bridge_name='br-int',has_traffic_filtering=True,id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4,network=Network(d131dd97-13f1-445c-af46-7c9c7e3527b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9ea24-ad') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a88e90ea-f95c-5593-b711-aebabaf650eb', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3e9ea24-ad, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3e9ea24-ad, col_values=(('qos', UUID('1705c3c9-8fc1-4e1a-acdb-27010523aecd')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3e9ea24-ad, col_values=(('external_ids', {'iface-id': 'c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:96:a8', 'vm-uuid': '5664a867-ffa0-4aae-9794-ee14a7d91e5e'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: INFO os_vif [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:96:a8,bridge_name='br-int',has_traffic_filtering=True,id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4,network=Network(d131dd97-13f1-445c-af46-7c9c7e3527b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9ea24-ad')
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] No VIF found with MAC fa:16:3e:20:96:a8, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updated VIF entry in instance network info cache for port c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updating instance_info_cache with network_info: [{"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9c1703cd-f430-48df-8170-f2186deee88f req-4bc38b9d-d362-4cb3-97b9-8369acce637b service nova] Releasing lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-502a0cf3-f537-4ccf-a337-aea2ff11df57 req-e73fcccd-9b11-42a5-a75d-6a066eabecbb service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-502a0cf3-f537-4ccf-a337-aea2ff11df57 req-e73fcccd-9b11-42a5-a75d-6a066eabecbb service nova] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-502a0cf3-f537-4ccf-a337-aea2ff11df57 req-e73fcccd-9b11-42a5-a75d-6a066eabecbb service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-502a0cf3-f537-4ccf-a337-aea2ff11df57 req-e73fcccd-9b11-42a5-a75d-6a066eabecbb service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-502a0cf3-f537-4ccf-a337-aea2ff11df57 req-e73fcccd-9b11-42a5-a75d-6a066eabecbb service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] No waiting events found dispatching network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:26 user nova-compute[75071]: WARNING nova.compute.manager [req-502a0cf3-f537-4ccf-a337-aea2ff11df57 req-e73fcccd-9b11-42a5-a75d-6a066eabecbb service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received unexpected event network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 for instance with vm_state building and task_state spawning.
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Instance spawned successfully.
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:27 user nova-compute[75071]: INFO nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Took 13.91 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:27 user nova-compute[75071]: INFO nova.compute.manager [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Took 15.43 seconds to build instance.
Nov 29 13:18:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42a0f783-5446-4b1d-82ec-df07c235cd40 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.646s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba2a1be4-5db5-48e0-9108-9b91d9085e3e req-809d1b84-3385-4b99-bf59-dc8112e222da service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba2a1be4-5db5-48e0-9108-9b91d9085e3e req-809d1b84-3385-4b99-bf59-dc8112e222da service nova] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba2a1be4-5db5-48e0-9108-9b91d9085e3e req-809d1b84-3385-4b99-bf59-dc8112e222da service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba2a1be4-5db5-48e0-9108-9b91d9085e3e req-809d1b84-3385-4b99-bf59-dc8112e222da service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba2a1be4-5db5-48e0-9108-9b91d9085e3e req-809d1b84-3385-4b99-bf59-dc8112e222da service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] No waiting events found dispatching network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:28 user nova-compute[75071]: WARNING nova.compute.manager [req-ba2a1be4-5db5-48e0-9108-9b91d9085e3e req-809d1b84-3385-4b99-bf59-dc8112e222da service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received unexpected event network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e for instance with vm_state active and task_state None.
Nov 29 13:18:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-083be9b2-3f5d-431c-938e-3eb70347a349 req-3acf3011-f072-4989-a501-0ead41cf23b7 service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-083be9b2-3f5d-431c-938e-3eb70347a349 req-3acf3011-f072-4989-a501-0ead41cf23b7 service nova] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-083be9b2-3f5d-431c-938e-3eb70347a349 req-3acf3011-f072-4989-a501-0ead41cf23b7 service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-083be9b2-3f5d-431c-938e-3eb70347a349 req-3acf3011-f072-4989-a501-0ead41cf23b7 service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-083be9b2-3f5d-431c-938e-3eb70347a349 req-3acf3011-f072-4989-a501-0ead41cf23b7 service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] No waiting events found dispatching network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:28 user nova-compute[75071]: WARNING nova.compute.manager [req-083be9b2-3f5d-431c-938e-3eb70347a349 req-3acf3011-f072-4989-a501-0ead41cf23b7 service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received unexpected event network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 for instance with vm_state building and task_state spawning.
Nov 29 13:18:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Instance spawned successfully.
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:29 user nova-compute[75071]: INFO nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Took 9.34 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:30 user nova-compute[75071]: INFO nova.compute.manager [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Took 11.44 seconds to build instance.
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25ec58dc-d856-4c77-a456-62506c455f91 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.700s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] No waiting events found dispatching network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:30 user nova-compute[75071]: WARNING nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received unexpected event network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e for instance with vm_state active and task_state None.
Nov 29 13:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:30 user nova-compute[75071]: WARNING nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received unexpected event network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 for instance with vm_state active and task_state None.
Nov 29 13:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:30 user nova-compute[75071]: WARNING nova.compute.manager [req-a5428597-b8bd-40e7-98e3-7a0615e7e865 req-f62c2d87-069b-40c8-b834-b9e13d6b52b3 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received unexpected event network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 for instance with vm_state active and task_state None.
Nov 29 13:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:18:31 user nova-compute[75071]: INFO nova.compute.claims [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Claim successful on node user
Nov 29 13:18:32 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:32 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.411s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:18:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:18:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG nova.policy [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8111debc03e84095bbc4a0e6f28b1345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97455887212d43b38034f553c20243ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:18:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Creating image(s)
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "/opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "/opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.382s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.243s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk 1073741824" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.442s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.292s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Successfully created port: d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Cannot resize image /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Ensure instance console log exists: /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Successfully updated port: d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquired lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-changed-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Refreshing instance network info cache due to event network-changed-d9af1c93-0d38-4750-82e0-caceb792b969. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] Acquiring lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:18:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updating instance_info_cache with network_info: [{"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Releasing lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Instance network_info: |[{"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] Acquired lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Refreshing network info cache for port d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Start _get_guest_xml network_info=[{"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:18:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-130401697',display_name='tempest-VolumesAssistedSnapshotsTest-server-130401697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-130401697',id=8,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPoEJxG331MraWo3pLaYgiXb7M1Q8EYo2H3jg3ajK7lTn5J8xbnXRAIwi3/YywiGYRlm41o3OLD4riYTb2kfnKDf8JcHoedUfSDIvylutKQor1y4QXxOYKK4tMO5gyVxA==',key_name='tempest-keypair-726720716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97455887212d43b38034f553c20243ca',ramdisk_id='',reservation_id='r-p74oi5y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-901336619',owner_user_name='tempest-VolumesAssistedSnapshotsTest-901336619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8111debc03e84095bbc4a0e6f28b1345',uuid=b3791790-3607-48cc-a6f3-d7eceedc6c88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Converting VIF {"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e7:bb,bridge_name='br-int',has_traffic_filtering=True,id=d9af1c93-0d38-4750-82e0-caceb792b969,network=Network(bef850f7-9ac4-487f-b687-2fa830a16f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9af1c93-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lazy-loading 'pci_devices' on Instance uuid b3791790-3607-48cc-a6f3-d7eceedc6c88 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:18:37 user nova-compute[75071]:   <uuid>b3791790-3607-48cc-a6f3-d7eceedc6c88</uuid>
Nov 29 13:18:37 user nova-compute[75071]:   <name>instance-00000008</name>
Nov 29 13:18:37 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:18:37 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:18:37 user nova-compute[75071]:   <metadata>
Nov 29 13:18:37 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:18:37 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:18:37 user nova-compute[75071]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-130401697</nova:name>
Nov 29 13:18:37 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:18:37</nova:creationTime>
Nov 29 13:18:37 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:18:37 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:18:37 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:18:37 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:18:37 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:18:37 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:18:37 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:18:37 user nova-compute[75071]:       <nova:owner>
Nov 29 13:18:37 user nova-compute[75071]:         <nova:user uuid="8111debc03e84095bbc4a0e6f28b1345">tempest-VolumesAssistedSnapshotsTest-901336619-project-member</nova:user>
Nov 29 13:18:37 user nova-compute[75071]:         <nova:project uuid="97455887212d43b38034f553c20243ca">tempest-VolumesAssistedSnapshotsTest-901336619</nova:project>
Nov 29 13:18:37 user nova-compute[75071]:       </nova:owner>
Nov 29 13:18:37 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:18:37 user nova-compute[75071]:       <nova:ports>
Nov 29 13:18:37 user nova-compute[75071]:         <nova:port uuid="d9af1c93-0d38-4750-82e0-caceb792b969">
Nov 29 13:18:37 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 13:18:37 user nova-compute[75071]:         </nova:port>
Nov 29 13:18:37 user nova-compute[75071]:       </nova:ports>
Nov 29 13:18:37 user nova-compute[75071]:     </nova:instance>
Nov 29 13:18:37 user nova-compute[75071]:   </metadata>
Nov 29 13:18:37 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:18:37 user nova-compute[75071]:     <system>
Nov 29 13:18:37 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:18:37 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:18:37 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:18:37 user nova-compute[75071]:       <entry name="serial">b3791790-3607-48cc-a6f3-d7eceedc6c88</entry>
Nov 29 13:18:37 user nova-compute[75071]:       <entry name="uuid">b3791790-3607-48cc-a6f3-d7eceedc6c88</entry>
Nov 29 13:18:37 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:18:37 user nova-compute[75071]:     </system>
Nov 29 13:18:37 user nova-compute[75071]:   </sysinfo>
Nov 29 13:18:37 user nova-compute[75071]:   <os>
Nov 29 13:18:37 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:18:37 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:18:37 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:18:37 user nova-compute[75071]:   </os>
Nov 29 13:18:37 user nova-compute[75071]:   <features>
Nov 29 13:18:37 user nova-compute[75071]:     <acpi/>
Nov 29 13:18:37 user nova-compute[75071]:     <apic/>
Nov 29 13:18:37 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:18:37 user nova-compute[75071]:   </features>
Nov 29 13:18:37 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:18:37 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:18:37 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:18:37 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:18:37 user nova-compute[75071]:   </clock>
Nov 29 13:18:37 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:18:37 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:18:37 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:18:37 user nova-compute[75071]:   </cpu>
Nov 29 13:18:37 user nova-compute[75071]:   <devices>
Nov 29 13:18:37 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:18:37 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:18:37 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk"/>
Nov 29 13:18:37 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:18:37 user nova-compute[75071]:     </disk>
Nov 29 13:18:37 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:18:37 user nova-compute[75071]:       <mac address="fa:16:3e:ff:e7:bb"/>
Nov 29 13:18:37 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:37 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:18:37 user nova-compute[75071]:       <target dev="tapd9af1c93-0d"/>
Nov 29 13:18:37 user nova-compute[75071]:     </interface>
Nov 29 13:18:37 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:18:37 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/console.log" append="off"/>
Nov 29 13:18:37 user nova-compute[75071]:     </serial>
Nov 29 13:18:37 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:18:37 user nova-compute[75071]:     <video>
Nov 29 13:18:37 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:18:37 user nova-compute[75071]:     </video>
Nov 29 13:18:37 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:18:37 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:18:37 user nova-compute[75071]:     </rng>
Nov 29 13:18:37 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:18:37 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:18:37 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:18:37 user nova-compute[75071]:     </memballoon>
Nov 29 13:18:37 user nova-compute[75071]:   </devices>
Nov 29 13:18:37 user nova-compute[75071]: </domain>
Nov 29 13:18:37 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-130401697',display_name='tempest-VolumesAssistedSnapshotsTest-server-130401697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-130401697',id=8,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPoEJxG331MraWo3pLaYgiXb7M1Q8EYo2H3jg3ajK7lTn5J8xbnXRAIwi3/YywiGYRlm41o3OLD4riYTb2kfnKDf8JcHoedUfSDIvylutKQor1y4QXxOYKK4tMO5gyVxA==',key_name='tempest-keypair-726720716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97455887212d43b38034f553c20243ca',ramdisk_id='',reservation_id='r-p74oi5y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-901336619',owner_user_name='tempest-VolumesAssistedSnapshotsTest-901336619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8111debc03e84095bbc4a0e6f28b1345',uuid=b3791790-3607-48cc-a6f3-d7eceedc6c88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Converting VIF {"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e7:bb,bridge_name='br-int',has_traffic_filtering=True,id=d9af1c93-0d38-4750-82e0-caceb792b969,network=Network(bef850f7-9ac4-487f-b687-2fa830a16f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9af1c93-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG os_vif [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e7:bb,bridge_name='br-int',has_traffic_filtering=True,id=d9af1c93-0d38-4750-82e0-caceb792b969,network=Network(bef850f7-9ac4-487f-b687-2fa830a16f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9af1c93-0d') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ff0b2ea-4436-592b-bce7-e16d891ed76e', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9af1c93-0d, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9af1c93-0d, col_values=(('qos', UUID('b718748b-0295-4127-9139-22e4a132967c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9af1c93-0d, col_values=(('external_ids', {'iface-id': 'd9af1c93-0d38-4750-82e0-caceb792b969', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:e7:bb', 'vm-uuid': 'b3791790-3607-48cc-a6f3-d7eceedc6c88'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:37 user nova-compute[75071]: INFO os_vif [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e7:bb,bridge_name='br-int',has_traffic_filtering=True,id=d9af1c93-0d38-4750-82e0-caceb792b969,network=Network(bef850f7-9ac4-487f-b687-2fa830a16f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9af1c93-0d')
Nov 29 13:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] No VIF found with MAC fa:16:3e:ff:e7:bb, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:18:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Skipping network cache update for instance because it is Building. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 945db3bb-5653-48f8-9c5f-2be1984e3cd2 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updated VIF entry in instance network info cache for port d9af1c93-0d38-4750-82e0-caceb792b969. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updating instance_info_cache with network_info: [{"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d80a0677-96d6-4dfb-8c6c-d7b3802211d1 req-cbf06c05-4024-4433-a242-ad12e663ffa0 service nova] Releasing lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updating instance_info_cache with network_info: [{"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-6c9df98f-1b70-4aef-9e64-88bbe54a7754 req-6e0a6b95-b909-4e48-b34f-0177b95f1ae8 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6c9df98f-1b70-4aef-9e64-88bbe54a7754 req-6e0a6b95-b909-4e48-b34f-0177b95f1ae8 service nova] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6c9df98f-1b70-4aef-9e64-88bbe54a7754 req-6e0a6b95-b909-4e48-b34f-0177b95f1ae8 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6c9df98f-1b70-4aef-9e64-88bbe54a7754 req-6e0a6b95-b909-4e48-b34f-0177b95f1ae8 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-6c9df98f-1b70-4aef-9e64-88bbe54a7754 req-6e0a6b95-b909-4e48-b34f-0177b95f1ae8 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] No waiting events found dispatching network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:40 user nova-compute[75071]: WARNING nova.compute.manager [req-6c9df98f-1b70-4aef-9e64-88bbe54a7754 req-6e0a6b95-b909-4e48-b34f-0177b95f1ae8 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received unexpected event network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 for instance with vm_state building and task_state spawning.
Nov 29 13:18:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:18:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Instance spawned successfully.
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:42 user nova-compute[75071]: INFO nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Took 9.05 seconds to spawn the instance on the hypervisor.
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-d9908cc8-dbca-4255-b901-aa2d9f1f2198 req-5fe33a89-61a0-443f-8386-a92eb27872a7 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d9908cc8-dbca-4255-b901-aa2d9f1f2198 req-5fe33a89-61a0-443f-8386-a92eb27872a7 service nova] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d9908cc8-dbca-4255-b901-aa2d9f1f2198 req-5fe33a89-61a0-443f-8386-a92eb27872a7 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d9908cc8-dbca-4255-b901-aa2d9f1f2198 req-5fe33a89-61a0-443f-8386-a92eb27872a7 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-d9908cc8-dbca-4255-b901-aa2d9f1f2198 req-5fe33a89-61a0-443f-8386-a92eb27872a7 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] No waiting events found dispatching network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:18:42 user nova-compute[75071]: WARNING nova.compute.manager [req-d9908cc8-dbca-4255-b901-aa2d9f1f2198 req-5fe33a89-61a0-443f-8386-a92eb27872a7 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received unexpected event network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 for instance with vm_state building and task_state spawning.
Nov 29 13:18:42 user nova-compute[75071]: INFO nova.compute.manager [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Took 11.09 seconds to build instance.
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e98b01f6-5641-4498-81a6-9ceb70b3ec0f tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.255s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:18:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:18:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=25.611202239990234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 014f79bb-e808-49e1-8d7a-c058b99c8377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b3791790-3607-48cc-a6f3-d7eceedc6c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:18:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:18:46 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:46 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.091s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:18:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:18:59 user nova-compute[75071]: INFO nova.compute.claims [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Claim successful on node user
Nov 29 13:18:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:18:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:18:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:18:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:18:59 user nova-compute[75071]: INFO nova.virt.block_device [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Booting with volume 4cee32b5-89d0-44e2-9b50-78f31cb3ac43 at /dev/vda
Nov 29 13:18:59 user nova-compute[75071]: DEBUG os_brick.utils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:18:59 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpg1gqsto5/privsep.sock']
Nov 29 13:19:00 user sudo[86040]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpg1gqsto5/privsep.sock
Nov 29 13:19:00 user sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 13:19:00 user nova-compute[75071]: DEBUG nova.policy [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6ca17d2c1724d629da1a03d0b364aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f167b8b34d843b7825306c314d9dbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:19:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully created port: bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully created port: 173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:01 user sudo[86040]: pam_unix(sudo:session): session closed for user root
Nov 29 13:19:01 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Spawned new privsep daemon via rootwrap
Nov 29 13:19:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 13:19:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 13:19:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 13:19:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86044
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1e8f6-2f9c-4895-9863-1739d125839e]: (2,) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[464d6ca0-c366-419d-a97f-26f17cf7b99d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.nvmeof [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bc934b-ba69-4c49-93be-4e3eedc06ecc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad423a-3474-469e-a62c-df4ceb31f7e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60478c3-83a5-4a4f-bc4f-d7ecba9b70a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:02 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:19:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd859da-2b2c-4c6d-9503-15dfc0a5b38d]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG os_brick.utils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== get_connector_properties: return (2058ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating existing volume attachment record: 5edae6e0-bd3e-497b-b3df-c2f0c3060b81 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully created port: f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully created port: 52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully created port: beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully updated port: bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-bebccb20-85a0-41c5-a67f-7bbc1ab30f97. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1cb32cf-85a0-4998-a2f1-58058c89d091 req-722e9adc-1540-4bf4-809d-a86acba24f68 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully updated port: d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully updated port: 408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully updated port: 173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-d4c11259-1723-4089-bafa-5491b75ae199. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-408b448c-f2e4-4146-942b-060a45c75697. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port 408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully updated port: f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-958e84ce-a855-4089-9a43-e0c7fe5b0c68 req-77682886-68d9-415c-b9ab-21971992fc88 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully updated port: 52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-173de29e-7f05-4c48-a99e-65c17978f884. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port 173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Successfully updated port: beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-f124cc96-77e3-4b2b-b319-329a2bc02877. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-52d3cf82-eb79-4cff-8340-6f6261ae86d2. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port 52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a66e600-fcd9-4891-9281-590419a4626a req-f5cac661-ba9f-4379-9445-73ae967e6c65 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:19:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-beb6c726-c067-4e1e-ae0c-33897dd13661. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:10 user nova-compute[75071]: INFO nova.virt.block_device [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Booting with volume f9d09130-7671-4e6d-bb03-4fcec62c07f2 at /dev/vdb
Nov 29 13:19:10 user nova-compute[75071]: DEBUG os_brick.utils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7210a46b-6b12-4c41-91b1-c62bdeb355a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4a3904-e422-48b8-8882-53934558402e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74994fd-508a-432d-8445-582064e5b9da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5caac46-0046-4b50-8867-fa078a170ca7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:10 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:19:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f02b9ad-9792-4090-8558-829496a34753]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG os_brick.utils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:10 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating existing volume attachment record: 989f32ba-0972-4f49-9298-36ecb0eea9a0 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [{"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance network_info: |[{"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updated VIF entry in instance network info cache for port beb6c726-c067-4e1e-ae0c-33897dd13661. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [{"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-07ded2dd-bb26-4acb-ab67-082501b6f90e req-ac00b3d7-2eb1-4bef-9a33-0ecdb036ab72 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:19 user nova-compute[75071]: INFO nova.virt.block_device [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Booting with volume 0ba36a45-7c5b-46c7-aba8-39acf108c2a5 at /dev/vdc
Nov 29 13:19:19 user nova-compute[75071]: DEBUG os_brick.utils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[449efba5-5ea9-4bab-b764-1b9cf4309142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0592e9be-2622-4bd2-a93d-f93d19543b58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8622393-0178-4cfb-8cb3-268c8bc3323b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd425328-2ad2-4abb-969b-249884b11738]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:19 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:19:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6db6cc6-fa1e-4a2f-8216-086d6863aab0]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG os_brick.utils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:19 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating existing volume attachment record: 1415a9e0-735e-4e5e-aa17-5dd85bfecbe8 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:19:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:19:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Creating image(s)
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Ensure instance console log exists: /opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Start _get_guest_xml network_info=[{"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYkPsTem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18f92aca-b5d2-4297-a767-e80a5dd92e42', 'attached_at': '', 'detached_at': '', 'volume_id': '4cee32b5-89d0-44e2-9b50-78f31cb3ac43', 'serial': '4cee32b5-89d0-44e2-9b50-78f31cb3ac43'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '5edae6e0-bd3e-497b-b3df-c2f0c3060b81', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYWDTKkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18f92aca-b5d2-4297-a767-e80a5dd92e42', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9d09130-7671-4e6d-bb03-4fcec62c07f2', 'serial': 'f9d09130-7671-4e6d-bb03-4fcec62c07f2'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '989f32ba-0972-4f49-9298-36ecb0eea9a0', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBGvzPyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18f92aca-b5d2-4297-a767-e80a5dd92e42', 'attached_at': '', 'detached_at': '', 'volume_id': '0ba36a45-7c5b-46c7-aba8-39acf108c2a5', 'serial': '0ba36a45-7c5b-46c7-aba8-39acf108c2a5'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '1415a9e0-735e-4e5e-aa17-5dd85bfecbe8', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:19:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connector [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Factory for ISCSI on None {{(pid=75071) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYkPsTem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:27 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:27 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:27 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4949bdf-6d24-4604-9eb7-09d83ca6edc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:19:27 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f9ea09-d759-4578-95e6-7582f670106e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43] added
Nov 29 13:19:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d7dccf-d30c-4918-b7c2-abee592c24e7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[358d1ddb-e914-4915-b78c-9ee404e71fb6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYkPsTem {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KYkPsTem" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8032a8-7da8-42c8-9950-0516d7446f94]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KYkPsTem'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c042374-bf98-408b-a551-4175580f2010]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eeb928-d175-4f39-b677-ba0348812304]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:19:27 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:19:27 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:27 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:19:27 user nova-compute[75071]: 
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a42271-472d-4359-a208-d6b7e301369d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260]
Nov 29 13:19:27 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260] successful.
Nov 29 13:19:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e309c-69a3-408f-91d4-582d0aa22335]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ffd3d4-0358-4403-8a6a-a194af0b98a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b22d943-811d-4bda-b9fe-e9f458e3f236]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYkPsTem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23338376465646531', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338376465646531', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYWDTKkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:28 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d471d2-00ff-4c64-a818-fcfc7ad3616c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:19:28 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef3ece-6b08-470a-8d11-9f36395f753e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2] added
Nov 29 13:19:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d42c2-d2bd-4f7a-a973-779bca630462]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08217b-5769-4f26-a43a-6c4e2b555217]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYWDTKkB {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYWDTKkB" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[81755b98-b10e-4ea5-ac0c-644ec102c391]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYWDTKkB'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08125a23-3fd9-4f76-87f9-3fec5487c84b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8228a-5606-42a8-bf95-6d19bc26f2a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e70d4-c1c0-49db-86e7-ca02ac2d47f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260]
Nov 29 13:19:28 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260] successful.
Nov 29 13:19:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02600c93-e065-45ad-a252-1129c7b71b25]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b88891a-983d-448a-a3f3-719d99d493e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:29 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:29 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57750b0e-d7d3-438a-9782-3032dd5a2c32]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:19:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYWDTKkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23263386430346365', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263386430346365', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBGvzPyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:30 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb5204-6741-4865-88a6-67b086190234]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:19:30 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdc0b38-8bb5-4a9b-8882-817d4134ee6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5] added
Nov 29 13:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e7ae11-2e0f-4630-aa81-c4b95d326347]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0ea990-8330-400b-b23b-cd164dbe5e55]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBGvzPyj {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBGvzPyj" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e275094c-7b54-4eac-a14b-0504863c8ce4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iBGvzPyj'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b5410-0b49-4fba-a044-587957afe678]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1fa060-d86d-4bd3-9496-ae0b6c36af2c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9aec2-1a7a-4a9c-86ae-bed31c5a5a30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260]
Nov 29 13:19:30 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260] successful.
Nov 29 13:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c0762-0abc-4855-9330-f0f23228870e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5e99c-0c58-4164-8b6b-85c6785ebaa5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e1d74e-2aa6-4315-93a1-e88e72610fbf]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBGvzPyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26237383264666361', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237383264666361', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:27:23,bridge_name='br-int',has_traffic_filtering=True,id=bebccb20-85a0-41c5-a67f-7bbc1ab30f97,network=Network(cb634a0d-e68e-411c-9245-d412ba6b769d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebccb20-85') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:90:91,bridge_name='br-int',has_traffic_filtering=True,id=d4c11259-1723-4089-bafa-5491b75ae199,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c11259-17') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=408b448c-f2e4-4146-942b-060a45c75697,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap408b448c-f2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=173de29e-7f05-4c48-a99e-65c17978f884,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap173de29e-7f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=f124cc96-77e3-4b2b-b319-329a2bc02877,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124cc96-77') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:9f,bridge_name='br-int',has_traffic_filtering=True,id=52d3cf82-eb79-4cff-8340-6f6261ae86d2,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d3cf82-eb') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:03:71,bridge_name='br-int',has_traffic_filtering=True,id=beb6c726-c067-4e1e-ae0c-33897dd13661,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb6c726-c0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lazy-loading 'pci_devices' on Instance uuid 18f92aca-b5d2-4297-a767-e80a5dd92e42 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:19:31 user nova-compute[75071]:   <uuid>18f92aca-b5d2-4297-a767-e80a5dd92e42</uuid>
Nov 29 13:19:31 user nova-compute[75071]:   <name>instance-00000009</name>
Nov 29 13:19:31 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:19:31 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:19:31 user nova-compute[75071]:   <metadata>
Nov 29 13:19:31 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:19:31 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:19:31 user nova-compute[75071]:       <nova:name>tempest-device-tagging-server-1182336340</nova:name>
Nov 29 13:19:31 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:19:27</nova:creationTime>
Nov 29 13:19:31 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:19:31 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:19:31 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:19:31 user nova-compute[75071]:       <nova:owner>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:user uuid="f6ca17d2c1724d629da1a03d0b364aa0">tempest-TaggedBootDevicesTest-1179462252-project-member</nova:user>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:project uuid="4f167b8b34d843b7825306c314d9dbea">tempest-TaggedBootDevicesTest-1179462252</nova:project>
Nov 29 13:19:31 user nova-compute[75071]:       </nova:owner>
Nov 29 13:19:31 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:19:31 user nova-compute[75071]:       <nova:ports>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:port uuid="bebccb20-85a0-41c5-a67f-7bbc1ab30f97">
Nov 29 13:19:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:19:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:port uuid="d4c11259-1723-4089-bafa-5491b75ae199">
Nov 29 13:19:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Nov 29 13:19:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:port uuid="408b448c-f2e4-4146-942b-060a45c75697">
Nov 29 13:19:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
Nov 29 13:19:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:port uuid="173de29e-7f05-4c48-a99e-65c17978f884">
Nov 29 13:19:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Nov 29 13:19:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:port uuid="f124cc96-77e3-4b2b-b319-329a2bc02877">
Nov 29 13:19:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Nov 29 13:19:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:port uuid="52d3cf82-eb79-4cff-8340-6f6261ae86d2">
Nov 29 13:19:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 13:19:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:31 user nova-compute[75071]:         <nova:port uuid="beb6c726-c067-4e1e-ae0c-33897dd13661">
Nov 29 13:19:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 13:19:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:31 user nova-compute[75071]:       </nova:ports>
Nov 29 13:19:31 user nova-compute[75071]:     </nova:instance>
Nov 29 13:19:31 user nova-compute[75071]:   </metadata>
Nov 29 13:19:31 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:19:31 user nova-compute[75071]:     <system>
Nov 29 13:19:31 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:19:31 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:19:31 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:19:31 user nova-compute[75071]:       <entry name="serial">18f92aca-b5d2-4297-a767-e80a5dd92e42</entry>
Nov 29 13:19:31 user nova-compute[75071]:       <entry name="uuid">18f92aca-b5d2-4297-a767-e80a5dd92e42</entry>
Nov 29 13:19:31 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:19:31 user nova-compute[75071]:     </system>
Nov 29 13:19:31 user nova-compute[75071]:   </sysinfo>
Nov 29 13:19:31 user nova-compute[75071]:   <os>
Nov 29 13:19:31 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:19:31 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:19:31 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:19:31 user nova-compute[75071]:   </os>
Nov 29 13:19:31 user nova-compute[75071]:   <features>
Nov 29 13:19:31 user nova-compute[75071]:     <acpi/>
Nov 29 13:19:31 user nova-compute[75071]:     <apic/>
Nov 29 13:19:31 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:19:31 user nova-compute[75071]:   </features>
Nov 29 13:19:31 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:19:31 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:19:31 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:19:31 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:19:31 user nova-compute[75071]:   </clock>
Nov 29 13:19:31 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:19:31 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:19:31 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:19:31 user nova-compute[75071]:   </cpu>
Nov 29 13:19:31 user nova-compute[75071]:   <devices>
Nov 29 13:19:31 user nova-compute[75071]:     <disk type="file" device="cdrom">
Nov 29 13:19:31 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 13:19:31 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42/disk.config"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="hda" bus="ide"/>
Nov 29 13:19:31 user nova-compute[75071]:     </disk>
Nov 29 13:19:31 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:19:31 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:19:31 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <serial>4cee32b5-89d0-44e2-9b50-78f31cb3ac43</serial>
Nov 29 13:19:31 user nova-compute[75071]:     </disk>
Nov 29 13:19:31 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:19:31 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:19:31 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <serial>f9d09130-7671-4e6d-bb03-4fcec62c07f2</serial>
Nov 29 13:19:31 user nova-compute[75071]:     </disk>
Nov 29 13:19:31 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:19:31 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:19:31 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <serial>0ba36a45-7c5b-46c7-aba8-39acf108c2a5</serial>
Nov 29 13:19:31 user nova-compute[75071]:     </disk>
Nov 29 13:19:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:31 user nova-compute[75071]:       <mac address="fa:16:3e:e5:27:23"/>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="tapbebccb20-85"/>
Nov 29 13:19:31 user nova-compute[75071]:     </interface>
Nov 29 13:19:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:31 user nova-compute[75071]:       <mac address="fa:16:3e:24:90:91"/>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="tapd4c11259-17"/>
Nov 29 13:19:31 user nova-compute[75071]:     </interface>
Nov 29 13:19:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:31 user nova-compute[75071]:       <mac address="fa:16:3e:49:a3:2a"/>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="tap408b448c-f2"/>
Nov 29 13:19:31 user nova-compute[75071]:     </interface>
Nov 29 13:19:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:31 user nova-compute[75071]:       <mac address="fa:16:3e:87:db:7d"/>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="tap173de29e-7f"/>
Nov 29 13:19:31 user nova-compute[75071]:     </interface>
Nov 29 13:19:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:31 user nova-compute[75071]:       <mac address="fa:16:3e:9c:2f:37"/>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="tapf124cc96-77"/>
Nov 29 13:19:31 user nova-compute[75071]:     </interface>
Nov 29 13:19:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:31 user nova-compute[75071]:       <mac address="fa:16:3e:a5:c4:9f"/>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="tap52d3cf82-eb"/>
Nov 29 13:19:31 user nova-compute[75071]:     </interface>
Nov 29 13:19:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:31 user nova-compute[75071]:       <mac address="fa:16:3e:35:03:71"/>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:31 user nova-compute[75071]:       <target dev="tapbeb6c726-c0"/>
Nov 29 13:19:31 user nova-compute[75071]:     </interface>
Nov 29 13:19:31 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:19:31 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42/console.log" append="off"/>
Nov 29 13:19:31 user nova-compute[75071]:     </serial>
Nov 29 13:19:31 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:19:31 user nova-compute[75071]:     <video>
Nov 29 13:19:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:31 user nova-compute[75071]:     </video>
Nov 29 13:19:31 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:19:31 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:19:31 user nova-compute[75071]:     </rng>
Nov 29 13:19:31 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:19:31 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:19:31 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:19:31 user nova-compute[75071]:     </memballoon>
Nov 29 13:19:31 user nova-compute[75071]:   </devices>
Nov 29 13:19:31 user nova-compute[75071]: </domain>
Nov 29 13:19:31 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:27:23,bridge_name='br-int',has_traffic_filtering=True,id=bebccb20-85a0-41c5-a67f-7bbc1ab30f97,network=Network(cb634a0d-e68e-411c-9245-d412ba6b769d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebccb20-85') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:27:23,bridge_name='br-int',has_traffic_filtering=True,id=bebccb20-85a0-41c5-a67f-7bbc1ab30f97,network=Network(cb634a0d-e68e-411c-9245-d412ba6b769d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebccb20-85') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35dbe861-fdeb-55bc-825a-eedad87a9a54', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbebccb20-85, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbebccb20-85, col_values=(('qos', UUID('aa1131f4-a153-4467-9ed9-5786e8630603')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbebccb20-85, col_values=(('external_ids', {'iface-id': 'bebccb20-85a0-41c5-a67f-7bbc1ab30f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:27:23', 'vm-uuid': '18f92aca-b5d2-4297-a767-e80a5dd92e42'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: INFO os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:27:23,bridge_name='br-int',has_traffic_filtering=True,id=bebccb20-85a0-41c5-a67f-7bbc1ab30f97,network=Network(cb634a0d-e68e-411c-9245-d412ba6b769d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebccb20-85')
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:90:91,bridge_name='br-int',has_traffic_filtering=True,id=d4c11259-1723-4089-bafa-5491b75ae199,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c11259-17') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:90:91,bridge_name='br-int',has_traffic_filtering=True,id=d4c11259-1723-4089-bafa-5491b75ae199,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c11259-17') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '044e8d2c-f10a-5597-95ab-78d45a9117f6', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4c11259-17, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4c11259-17, col_values=(('qos', UUID('829697cd-9461-4c9a-ba04-aaf5a43c3fcb')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4c11259-17, col_values=(('external_ids', {'iface-id': 'd4c11259-1723-4089-bafa-5491b75ae199', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:90:91', 'vm-uuid': '18f92aca-b5d2-4297-a767-e80a5dd92e42'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: INFO os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:90:91,bridge_name='br-int',has_traffic_filtering=True,id=d4c11259-1723-4089-bafa-5491b75ae199,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c11259-17')
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=408b448c-f2e4-4146-942b-060a45c75697,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap408b448c-f2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=408b448c-f2e4-4146-942b-060a45c75697,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap408b448c-f2') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c034d8af-184d-5422-ac31-ee08c0680833', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap408b448c-f2, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap408b448c-f2, col_values=(('qos', UUID('5d149b79-4efd-464c-9749-71073ec2c816')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap408b448c-f2, col_values=(('external_ids', {'iface-id': '408b448c-f2e4-4146-942b-060a45c75697', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:a3:2a', 'vm-uuid': '18f92aca-b5d2-4297-a767-e80a5dd92e42'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: INFO os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=408b448c-f2e4-4146-942b-060a45c75697,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap408b448c-f2')
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=173de29e-7f05-4c48-a99e-65c17978f884,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap173de29e-7f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=173de29e-7f05-4c48-a99e-65c17978f884,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap173de29e-7f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '784324de-d790-5832-8ffa-e9d033858068', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap173de29e-7f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap173de29e-7f, col_values=(('qos', UUID('084f5bfb-042a-483d-9af2-5620dd0294ab')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap173de29e-7f, col_values=(('external_ids', {'iface-id': '173de29e-7f05-4c48-a99e-65c17978f884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:db:7d', 'vm-uuid': '18f92aca-b5d2-4297-a767-e80a5dd92e42'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: INFO os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=173de29e-7f05-4c48-a99e-65c17978f884,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap173de29e-7f')
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=f124cc96-77e3-4b2b-b319-329a2bc02877,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124cc96-77') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=f124cc96-77e3-4b2b-b319-329a2bc02877,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124cc96-77') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6cafaf5-4be0-57d2-ac33-c032127d7bde', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf124cc96-77, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf124cc96-77, col_values=(('qos', UUID('daaacd7f-6288-40ec-aa95-30bac3f2570b')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf124cc96-77, col_values=(('external_ids', {'iface-id': 'f124cc96-77e3-4b2b-b319-329a2bc02877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:2f:37', 'vm-uuid': '18f92aca-b5d2-4297-a767-e80a5dd92e42'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: INFO os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=f124cc96-77e3-4b2b-b319-329a2bc02877,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124cc96-77')
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:9f,bridge_name='br-int',has_traffic_filtering=True,id=52d3cf82-eb79-4cff-8340-6f6261ae86d2,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d3cf82-eb') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:9f,bridge_name='br-int',has_traffic_filtering=True,id=52d3cf82-eb79-4cff-8340-6f6261ae86d2,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d3cf82-eb') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ed36eb1-34dd-5144-8c6b-41e1c0960ed1', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52d3cf82-eb, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52d3cf82-eb, col_values=(('qos', UUID('3da2ce95-f5e1-4add-ae1c-4a6bf8efbea8')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52d3cf82-eb, col_values=(('external_ids', {'iface-id': '52d3cf82-eb79-4cff-8340-6f6261ae86d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:c4:9f', 'vm-uuid': '18f92aca-b5d2-4297-a767-e80a5dd92e42'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: INFO os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:9f,bridge_name='br-int',has_traffic_filtering=True,id=52d3cf82-eb79-4cff-8340-6f6261ae86d2,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d3cf82-eb')
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:03:71,bridge_name='br-int',has_traffic_filtering=True,id=beb6c726-c067-4e1e-ae0c-33897dd13661,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb6c726-c0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:03:71,bridge_name='br-int',has_traffic_filtering=True,id=beb6c726-c067-4e1e-ae0c-33897dd13661,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb6c726-c0') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b5ad554-ed33-5bd3-8a01-972bfdef63c1', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbeb6c726-c0, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbeb6c726-c0, col_values=(('qos', UUID('21008798-68ee-4f8a-8d05-3e6715cbf626')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbeb6c726-c0, col_values=(('external_ids', {'iface-id': 'beb6c726-c067-4e1e-ae0c-33897dd13661', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:03:71', 'vm-uuid': '18f92aca-b5d2-4297-a767-e80a5dd92e42'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:32 user nova-compute[75071]: INFO os_vif [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:03:71,bridge_name='br-int',has_traffic_filtering=True,id=beb6c726-c067-4e1e-ae0c-33897dd13661,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb6c726-c0')
Nov 29 13:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] No VIF found with MAC fa:16:3e:e5:27:23, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] No VIF found with MAC fa:16:3e:9c:2f:37, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:19:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Using config drive
Nov 29 13:19:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Creating config drive at /opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42/disk.config
Nov 29 13:19:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkcwc8f83 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkcwc8f83" returned: 0 in 0.071s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-e98bf8ef-2706-4c56-ad89-02a8a6ca2127 req-ec595be2-75b6-4732-b0d5-93007f8590f6 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e98bf8ef-2706-4c56-ad89-02a8a6ca2127 req-ec595be2-75b6-4732-b0d5-93007f8590f6 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e98bf8ef-2706-4c56-ad89-02a8a6ca2127 req-ec595be2-75b6-4732-b0d5-93007f8590f6 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e98bf8ef-2706-4c56-ad89-02a8a6ca2127 req-ec595be2-75b6-4732-b0d5-93007f8590f6 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-e98bf8ef-2706-4c56-ad89-02a8a6ca2127 req-ec595be2-75b6-4732-b0d5-93007f8590f6 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:34 user nova-compute[75071]: WARNING nova.compute.manager [req-e98bf8ef-2706-4c56-ad89-02a8a6ca2127 req-ec595be2-75b6-4732-b0d5-93007f8590f6 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 for instance with vm_state building and task_state spawning.
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-1acfe71b-b4e9-4b63-9de5-55fcf8771f5b req-25568149-94c2-43b7-b878-c56dfe616cba service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1acfe71b-b4e9-4b63-9de5-55fcf8771f5b req-25568149-94c2-43b7-b878-c56dfe616cba service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1acfe71b-b4e9-4b63-9de5-55fcf8771f5b req-25568149-94c2-43b7-b878-c56dfe616cba service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1acfe71b-b4e9-4b63-9de5-55fcf8771f5b req-25568149-94c2-43b7-b878-c56dfe616cba service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-1acfe71b-b4e9-4b63-9de5-55fcf8771f5b req-25568149-94c2-43b7-b878-c56dfe616cba service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:35 user nova-compute[75071]: WARNING nova.compute.manager [req-1acfe71b-b4e9-4b63-9de5-55fcf8771f5b req-25568149-94c2-43b7-b878-c56dfe616cba service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 for instance with vm_state building and task_state spawning.
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:36 user nova-compute[75071]: WARNING nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 for instance with vm_state building and task_state spawning.
Nov 29 13:19:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:36 user nova-compute[75071]: WARNING nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 for instance with vm_state building and task_state spawning.
Nov 29 13:19:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:36 user nova-compute[75071]: WARNING nova.compute.manager [req-f492cb0d-47a2-4884-aa4e-4abae6485c3b req-3bf142ee-5bba-41ea-a4dd-f55d4f45eed9 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 for instance with vm_state building and task_state spawning.
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:19:37 user nova-compute[75071]: INFO nova.compute.claims [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Claim successful on node user
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:19:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.policy [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '754229134eaf4fd18d8b0680e74ddd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33dac7a205d476ba368ab85fa20387d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:37 user nova-compute[75071]: WARNING nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 for instance with vm_state building and task_state spawning.
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:37 user nova-compute[75071]: WARNING nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 for instance with vm_state building and task_state spawning.
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:37 user nova-compute[75071]: WARNING nova.compute.manager [req-d863d798-2c37-43d5-933d-a412ac0f28e0 req-8f16526b-a3ea-43b1-81df-3762ed6c1fa0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 for instance with vm_state building and task_state spawning.
Nov 29 13:19:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:19:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:19:38 user nova-compute[75071]: INFO nova.virt.block_device [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Booting with volume 49892357-0234-42db-918a-026a37e4f1f1 at /dev/vda
Nov 29 13:19:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG os_brick.utils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e295a-2063-4168-9591-99947a20b7f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec394bf-c965-4d3f-b9ee-7a8f0847e70a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90dca40-6d9c-4a08-96b3-4b90c8d7ece4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df232c7a-31d2-4a09-a170-2cdc23dc722e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb7e4054-b826-4c4f-b97b-ccc18c82070a req-c6582b2d-07ff-4bb2-a494-aa1e268f01e0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb7e4054-b826-4c4f-b97b-ccc18c82070a req-c6582b2d-07ff-4bb2-a494-aa1e268f01e0 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb7e4054-b826-4c4f-b97b-ccc18c82070a req-c6582b2d-07ff-4bb2-a494-aa1e268f01e0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb7e4054-b826-4c4f-b97b-ccc18c82070a req-c6582b2d-07ff-4bb2-a494-aa1e268f01e0 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb7e4054-b826-4c4f-b97b-ccc18c82070a req-c6582b2d-07ff-4bb2-a494-aa1e268f01e0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:38 user nova-compute[75071]: WARNING nova.compute.manager [req-eb7e4054-b826-4c4f-b97b-ccc18c82070a req-c6582b2d-07ff-4bb2-a494-aa1e268f01e0 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 for instance with vm_state building and task_state spawning.
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:38 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cc935-66a3-4680-998e-701f35856f91]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG os_brick.utils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating existing volume attachment record: d718e3bc-6d6a-472c-ab5e-766d743df9e2 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:38 user nova-compute[75071]: WARNING nova.compute.manager [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 for instance with vm_state building and task_state spawning.
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:38 user nova-compute[75071]: WARNING nova.compute.manager [req-f11842e8-088b-4b8b-b79a-bfd3769722ea req-18ed03c0-097b-43b6-a9f6-6c32cbc9e374 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 for instance with vm_state building and task_state spawning.
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:19:39 user nova-compute[75071]: INFO nova.compute.claims [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Claim successful on node user
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:19:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance spawned successfully.
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:39 user nova-compute[75071]: INFO nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Took 12.13 seconds to spawn the instance on the hypervisor.
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Successfully created port: ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:39 user nova-compute[75071]: INFO nova.compute.manager [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Took 40.59 seconds to build instance.
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c95aafc-e73e-41ce-885b-6f550728383c tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.704s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:19:39 user nova-compute[75071]: DEBUG nova.policy [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd83bac00dc8a40559ff4b0f0673c79a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a7845e453c40d59a3fc56db2d3beb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:19:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Creating image(s)
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "/opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "/opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:40 user nova-compute[75071]: WARNING nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 for instance with vm_state active and task_state None.
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:40 user nova-compute[75071]: WARNING nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 for instance with vm_state active and task_state None.
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:40 user nova-compute[75071]: WARNING nova.compute.manager [req-c980deff-fed1-4031-af3c-be717c73863e req-8b5e518e-7c10-449a-841f-ce32d68fd737 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 for instance with vm_state active and task_state None.
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Successfully updated port: ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk 1073741824" returned: 0 in 0.072s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquired lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Successfully created port: 3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.214s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Cannot resize image /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Ensure instance console log exists: /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Releasing lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance network_info: |[{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Successfully updated port: 3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "refresh_cache-9ad6a28c-21f9-468a-b81a-5d1b75e78ede" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquired lock "refresh_cache-9ad6a28c-21f9-468a-b81a-5d1b75e78ede" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received event network-changed-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Refreshing instance network info cache due to event network-changed-3dd13435-6faf-46a2-be5a-8b8428abb12b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] Acquiring lock "refresh_cache-9ad6a28c-21f9-468a-b81a-5d1b75e78ede" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Updating instance_info_cache with network_info: [{"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Releasing lock "refresh_cache-9ad6a28c-21f9-468a-b81a-5d1b75e78ede" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Instance network_info: |[{"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] Acquired lock "refresh_cache-9ad6a28c-21f9-468a-b81a-5d1b75e78ede" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Refreshing network info cache for port 3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Start _get_guest_xml network_info=[{"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:19:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1812241087',display_name='tempest-ServersNegativeTestJSON-server-1812241087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1812241087',id=11,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a7845e453c40d59a3fc56db2d3beb0',ramdisk_id='',reservation_id='r-zablm2or',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-308617736',owner_user_name='tempest-ServersNegativeTestJSON-308617736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:40Z,user_data=None,user_id='d83bac00dc8a40559ff4b0f0673c79a0',uuid=9ad6a28c-21f9-468a-b81a-5d1b75e78ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converting VIF {"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:60:91,bridge_name='br-int',has_traffic_filtering=True,id=3dd13435-6faf-46a2-be5a-8b8428abb12b,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd13435-6f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad6a28c-21f9-468a-b81a-5d1b75e78ede {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:19:41 user nova-compute[75071]:   <uuid>9ad6a28c-21f9-468a-b81a-5d1b75e78ede</uuid>
Nov 29 13:19:41 user nova-compute[75071]:   <name>instance-0000000b</name>
Nov 29 13:19:41 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:19:41 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:19:41 user nova-compute[75071]:   <metadata>
Nov 29 13:19:41 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:19:41 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:19:41 user nova-compute[75071]:       <nova:name>tempest-ServersNegativeTestJSON-server-1812241087</nova:name>
Nov 29 13:19:41 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:19:41</nova:creationTime>
Nov 29 13:19:41 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:19:41 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:19:41 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:19:41 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:19:41 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:19:41 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:19:41 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:19:41 user nova-compute[75071]:       <nova:owner>
Nov 29 13:19:41 user nova-compute[75071]:         <nova:user uuid="d83bac00dc8a40559ff4b0f0673c79a0">tempest-ServersNegativeTestJSON-308617736-project-member</nova:user>
Nov 29 13:19:41 user nova-compute[75071]:         <nova:project uuid="12a7845e453c40d59a3fc56db2d3beb0">tempest-ServersNegativeTestJSON-308617736</nova:project>
Nov 29 13:19:41 user nova-compute[75071]:       </nova:owner>
Nov 29 13:19:41 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:19:41 user nova-compute[75071]:       <nova:ports>
Nov 29 13:19:41 user nova-compute[75071]:         <nova:port uuid="3dd13435-6faf-46a2-be5a-8b8428abb12b">
Nov 29 13:19:41 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 13:19:41 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:41 user nova-compute[75071]:       </nova:ports>
Nov 29 13:19:41 user nova-compute[75071]:     </nova:instance>
Nov 29 13:19:41 user nova-compute[75071]:   </metadata>
Nov 29 13:19:41 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:19:41 user nova-compute[75071]:     <system>
Nov 29 13:19:41 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:19:41 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:19:41 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:19:41 user nova-compute[75071]:       <entry name="serial">9ad6a28c-21f9-468a-b81a-5d1b75e78ede</entry>
Nov 29 13:19:41 user nova-compute[75071]:       <entry name="uuid">9ad6a28c-21f9-468a-b81a-5d1b75e78ede</entry>
Nov 29 13:19:41 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:19:41 user nova-compute[75071]:     </system>
Nov 29 13:19:41 user nova-compute[75071]:   </sysinfo>
Nov 29 13:19:41 user nova-compute[75071]:   <os>
Nov 29 13:19:41 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:19:41 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:19:41 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:19:41 user nova-compute[75071]:   </os>
Nov 29 13:19:41 user nova-compute[75071]:   <features>
Nov 29 13:19:41 user nova-compute[75071]:     <acpi/>
Nov 29 13:19:41 user nova-compute[75071]:     <apic/>
Nov 29 13:19:41 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:19:41 user nova-compute[75071]:   </features>
Nov 29 13:19:41 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:19:41 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:19:41 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:19:41 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:19:41 user nova-compute[75071]:   </clock>
Nov 29 13:19:41 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:19:41 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:19:41 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:19:41 user nova-compute[75071]:   </cpu>
Nov 29 13:19:41 user nova-compute[75071]:   <devices>
Nov 29 13:19:41 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:19:41 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:19:41 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk"/>
Nov 29 13:19:41 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:19:41 user nova-compute[75071]:     </disk>
Nov 29 13:19:41 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:41 user nova-compute[75071]:       <mac address="fa:16:3e:7f:60:91"/>
Nov 29 13:19:41 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:41 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:41 user nova-compute[75071]:       <target dev="tap3dd13435-6f"/>
Nov 29 13:19:41 user nova-compute[75071]:     </interface>
Nov 29 13:19:41 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:19:41 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/console.log" append="off"/>
Nov 29 13:19:41 user nova-compute[75071]:     </serial>
Nov 29 13:19:41 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:19:41 user nova-compute[75071]:     <video>
Nov 29 13:19:41 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:41 user nova-compute[75071]:     </video>
Nov 29 13:19:41 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:19:41 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:19:41 user nova-compute[75071]:     </rng>
Nov 29 13:19:41 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:19:41 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:19:41 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:19:41 user nova-compute[75071]:     </memballoon>
Nov 29 13:19:41 user nova-compute[75071]:   </devices>
Nov 29 13:19:41 user nova-compute[75071]: </domain>
Nov 29 13:19:41 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1812241087',display_name='tempest-ServersNegativeTestJSON-server-1812241087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1812241087',id=11,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a7845e453c40d59a3fc56db2d3beb0',ramdisk_id='',reservation_id='r-zablm2or',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-308617736',owner_user_name='tempest-ServersNegativeTestJSON-308617736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:40Z,user_data=None,user_id='d83bac00dc8a40559ff4b0f0673c79a0',uuid=9ad6a28c-21f9-468a-b81a-5d1b75e78ede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converting VIF {"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:60:91,bridge_name='br-int',has_traffic_filtering=True,id=3dd13435-6faf-46a2-be5a-8b8428abb12b,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd13435-6f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG os_vif [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:60:91,bridge_name='br-int',has_traffic_filtering=True,id=3dd13435-6faf-46a2-be5a-8b8428abb12b,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd13435-6f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '770e4367-537c-59ee-8a7e-959f5bdfe0cc', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dd13435-6f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dd13435-6f, col_values=(('qos', UUID('b4180461-2144-4284-b109-a90a3d4c37a2')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dd13435-6f, col_values=(('external_ids', {'iface-id': '3dd13435-6faf-46a2-be5a-8b8428abb12b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:60:91', 'vm-uuid': '9ad6a28c-21f9-468a-b81a-5d1b75e78ede'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:41 user nova-compute[75071]: INFO os_vif [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:60:91,bridge_name='br-int',has_traffic_filtering=True,id=3dd13435-6faf-46a2-be5a-8b8428abb12b,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd13435-6f')
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] No VIF found with MAC fa:16:3e:7f:60:91, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Updated VIF entry in instance network info cache for port 3dd13435-6faf-46a2-be5a-8b8428abb12b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Updating instance_info_cache with network_info: [{"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dbe2835d-b968-4f81-bfdd-0a19898a843f req-e3f2bd17-55a7-48c7-8405-01e175d90d85 service nova] Releasing lock "refresh_cache-9ad6a28c-21f9-468a-b81a-5d1b75e78ede" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing instance network info cache due to event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] Acquiring lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] Acquired lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updated VIF entry in instance network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73513b86-d3aa-411c-a051-c48ffee40492 req-550a2bd9-fba7-4cd9-a74a-34a4e568e2f0 service nova] Releasing lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:19:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-56edcd2f-a817-4026-bdbd-2c2ab71f1486 req-8a4623bc-0356-4c2b-8065-57789c14eadf service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received event network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-56edcd2f-a817-4026-bdbd-2c2ab71f1486 req-8a4623bc-0356-4c2b-8065-57789c14eadf service nova] Acquiring lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-56edcd2f-a817-4026-bdbd-2c2ab71f1486 req-8a4623bc-0356-4c2b-8065-57789c14eadf service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-56edcd2f-a817-4026-bdbd-2c2ab71f1486 req-8a4623bc-0356-4c2b-8065-57789c14eadf service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-56edcd2f-a817-4026-bdbd-2c2ab71f1486 req-8a4623bc-0356-4c2b-8065-57789c14eadf service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] No waiting events found dispatching network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:46 user nova-compute[75071]: WARNING nova.compute.manager [req-56edcd2f-a817-4026-bdbd-2c2ab71f1486 req-8a4623bc-0356-4c2b-8065-57789c14eadf service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received unexpected event network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b for instance with vm_state building and task_state spawning.
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-changed-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Refreshing instance network info cache due to event network-changed-c4e3d926-2ca7-42cc-9a76-5bc4db72803e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Refreshing network info cache for port c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-86274ec2-5bb5-4dc1-b33e-9f2dc23b4f14 req-6ad90024-27a1-4700-9dbf-13e2a40ee53b service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received event network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-86274ec2-5bb5-4dc1-b33e-9f2dc23b4f14 req-6ad90024-27a1-4700-9dbf-13e2a40ee53b service nova] Acquiring lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-86274ec2-5bb5-4dc1-b33e-9f2dc23b4f14 req-6ad90024-27a1-4700-9dbf-13e2a40ee53b service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-86274ec2-5bb5-4dc1-b33e-9f2dc23b4f14 req-6ad90024-27a1-4700-9dbf-13e2a40ee53b service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-86274ec2-5bb5-4dc1-b33e-9f2dc23b4f14 req-6ad90024-27a1-4700-9dbf-13e2a40ee53b service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] No waiting events found dispatching network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:46 user nova-compute[75071]: WARNING nova.compute.manager [req-86274ec2-5bb5-4dc1-b33e-9f2dc23b4f14 req-6ad90024-27a1-4700-9dbf-13e2a40ee53b service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received unexpected event network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b for instance with vm_state building and task_state spawning.
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:19:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7274MB free_disk=25.50505828857422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Instance spawned successfully.
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:46 user nova-compute[75071]: INFO nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Took 6.40 seconds to spawn the instance on the hypervisor.
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 014f79bb-e808-49e1-8d7a-c058b99c8377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b3791790-3607-48cc-a6f3-d7eceedc6c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 18f92aca-b5d2-4297-a767-e80a5dd92e42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 89d407c4-7e0e-4213-a2a2-99d547c42a4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9ad6a28c-21f9-468a-b81a-5d1b75e78ede actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:19:46 user nova-compute[75071]: INFO nova.compute.manager [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Took 7.60 seconds to build instance.
Nov 29 13:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-646b584c-a747-45fe-9a61-930e57ab80f7 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.939s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updated VIF entry in instance network info cache for port c4e3d926-2ca7-42cc-9a76-5bc4db72803e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-320c2ed6-dbd8-4bc0-a7bd-7eae3269fc7a req-23da4f65-dfae-4fe6-bd8e-c571547ebd8f service nova] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.013s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:19:49 user nova-compute[75071]: INFO nova.compute.claims [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Claim successful on node user
Nov 29 13:19:49 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:19:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.policy [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d54f49fa05c4317bb667c1877cb466a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f58750d5b84ed9847af078c31c0004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:19:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Creating image(s)
Nov 29 13:19:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "/opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "/opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "d572025d0512daacab52078314a5ef34b69b5305" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "d572025d0512daacab52078314a5ef34b69b5305" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-changed-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Refreshing instance network info cache due to event network-changed-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Refreshing network info cache for port 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Successfully created port: fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.part --force-share --output=json" returned: 0 in 0.257s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.virt.images [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] 1d86e741-7224-4df1-9d02-dd4ede829179 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.part /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing instance network info cache due to event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.part /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.converted" returned: 0 in 0.232s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305.converted --force-share --output=json" returned: 0 in 0.274s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "d572025d0512daacab52078314a5ef34b69b5305" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.552s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updated VIF entry in instance network info cache for port 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Successfully updated port: fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquired lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-661b59eb-bad5-47e3-ba43-0b85960641f0 req-1ad81c53-c578-44b5-b28a-2c315a7387d5 service nova] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing instance network info cache due to event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] Acquiring lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json" returned: 0 in 0.219s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "d572025d0512daacab52078314a5ef34b69b5305" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "d572025d0512daacab52078314a5ef34b69b5305" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updated VIF entry in instance network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d8b5aeef-6ad5-41e6-b5b8-3aa51991e56c req-f47c7b40-dd7f-4f13-88e6-900d013f8235 service nova] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305,backing_fmt=raw /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305,backing_fmt=raw /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk 1073741824" returned: 0 in 0.073s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "d572025d0512daacab52078314a5ef34b69b5305" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Releasing lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance network_info: |[{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] Acquired lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Cannot resize image /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Ensure instance console log exists: /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Start _get_guest_xml network_info=[{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:19:46Z,direct_url=<?>,disk_format='qcow2',id=1d86e741-7224-4df1-9d02-dd4ede829179,min_disk=0,min_ram=0,name='tempest-scenario-img--474351526',owner='50f58750d5b84ed9847af078c31c0004',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:19:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1d86e741-7224-4df1-9d02-dd4ede829179'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:19:52 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:52 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:19:46Z,direct_url=<?>,disk_format='qcow2',id=1d86e741-7224-4df1-9d02-dd4ede829179,min_disk=0,min_ram=0,name='tempest-scenario-img--474351526',owner='50f58750d5b84ed9847af078c31c0004',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:19:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696092294',display_name='tempest-TestMinimumBasicScenario-server-1696092294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696092294',id=12,image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OU7wq777KNWtgTh49zMjolfl5F1CAP90X7BiOt3SVRTfAL0/XiizPFpYgWG55eFSvJkVxqUafEM3VDJwguK4WlVeppff2vZX9SAzGFHKsBnuuhLuRfBpx/2LcaRwUGQ==',key_name='tempest-TestMinimumBasicScenario-664367511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-gx0s410n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:50Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=f7c9047c-00f3-4cb3-9290-6d118bda1c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:19:52 user nova-compute[75071]:   <uuid>f7c9047c-00f3-4cb3-9290-6d118bda1c9c</uuid>
Nov 29 13:19:52 user nova-compute[75071]:   <name>instance-0000000c</name>
Nov 29 13:19:52 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:19:52 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:19:52 user nova-compute[75071]:   <metadata>
Nov 29 13:19:52 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:19:52 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:19:52 user nova-compute[75071]:       <nova:name>tempest-TestMinimumBasicScenario-server-1696092294</nova:name>
Nov 29 13:19:52 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:19:52</nova:creationTime>
Nov 29 13:19:52 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:19:52 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:19:52 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:19:52 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:19:52 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:19:52 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:19:52 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:19:52 user nova-compute[75071]:       <nova:owner>
Nov 29 13:19:52 user nova-compute[75071]:         <nova:user uuid="0d54f49fa05c4317bb667c1877cb466a">tempest-TestMinimumBasicScenario-182325840-project-member</nova:user>
Nov 29 13:19:52 user nova-compute[75071]:         <nova:project uuid="50f58750d5b84ed9847af078c31c0004">tempest-TestMinimumBasicScenario-182325840</nova:project>
Nov 29 13:19:52 user nova-compute[75071]:       </nova:owner>
Nov 29 13:19:52 user nova-compute[75071]:       <nova:root type="image" uuid="1d86e741-7224-4df1-9d02-dd4ede829179"/>
Nov 29 13:19:52 user nova-compute[75071]:       <nova:ports>
Nov 29 13:19:52 user nova-compute[75071]:         <nova:port uuid="fc66d61b-df87-483c-96a1-89033c9deaa8">
Nov 29 13:19:52 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:19:52 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:52 user nova-compute[75071]:       </nova:ports>
Nov 29 13:19:52 user nova-compute[75071]:     </nova:instance>
Nov 29 13:19:52 user nova-compute[75071]:   </metadata>
Nov 29 13:19:52 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:19:52 user nova-compute[75071]:     <system>
Nov 29 13:19:52 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:19:52 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:19:52 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:19:52 user nova-compute[75071]:       <entry name="serial">f7c9047c-00f3-4cb3-9290-6d118bda1c9c</entry>
Nov 29 13:19:52 user nova-compute[75071]:       <entry name="uuid">f7c9047c-00f3-4cb3-9290-6d118bda1c9c</entry>
Nov 29 13:19:52 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:19:52 user nova-compute[75071]:     </system>
Nov 29 13:19:52 user nova-compute[75071]:   </sysinfo>
Nov 29 13:19:52 user nova-compute[75071]:   <os>
Nov 29 13:19:52 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:19:52 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:19:52 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:19:52 user nova-compute[75071]:   </os>
Nov 29 13:19:52 user nova-compute[75071]:   <features>
Nov 29 13:19:52 user nova-compute[75071]:     <acpi/>
Nov 29 13:19:52 user nova-compute[75071]:     <apic/>
Nov 29 13:19:52 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:19:52 user nova-compute[75071]:   </features>
Nov 29 13:19:52 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:19:52 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:19:52 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:19:52 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:19:52 user nova-compute[75071]:   </clock>
Nov 29 13:19:52 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:19:52 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:19:52 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:19:52 user nova-compute[75071]:   </cpu>
Nov 29 13:19:52 user nova-compute[75071]:   <devices>
Nov 29 13:19:52 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:19:52 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:19:52 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk"/>
Nov 29 13:19:52 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:19:52 user nova-compute[75071]:     </disk>
Nov 29 13:19:52 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:52 user nova-compute[75071]:       <mac address="fa:16:3e:90:2e:ad"/>
Nov 29 13:19:52 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:52 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:52 user nova-compute[75071]:       <target dev="tapfc66d61b-df"/>
Nov 29 13:19:52 user nova-compute[75071]:     </interface>
Nov 29 13:19:52 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:19:52 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/console.log" append="off"/>
Nov 29 13:19:52 user nova-compute[75071]:     </serial>
Nov 29 13:19:52 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:19:52 user nova-compute[75071]:     <video>
Nov 29 13:19:52 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:52 user nova-compute[75071]:     </video>
Nov 29 13:19:52 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:19:52 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:19:52 user nova-compute[75071]:     </rng>
Nov 29 13:19:52 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:19:52 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:19:52 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:19:52 user nova-compute[75071]:     </memballoon>
Nov 29 13:19:52 user nova-compute[75071]:   </devices>
Nov 29 13:19:52 user nova-compute[75071]: </domain>
Nov 29 13:19:52 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696092294',display_name='tempest-TestMinimumBasicScenario-server-1696092294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696092294',id=12,image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OU7wq777KNWtgTh49zMjolfl5F1CAP90X7BiOt3SVRTfAL0/XiizPFpYgWG55eFSvJkVxqUafEM3VDJwguK4WlVeppff2vZX9SAzGFHKsBnuuhLuRfBpx/2LcaRwUGQ==',key_name='tempest-TestMinimumBasicScenario-664367511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-gx0s410n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:50Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=f7c9047c-00f3-4cb3-9290-6d118bda1c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG os_vif [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99dbfdea-a429-5643-8d2b-d702e94cea1f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc66d61b-df, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc66d61b-df, col_values=(('qos', UUID('51a6743d-ba5b-4396-b319-f95d716cfec5')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc66d61b-df, col_values=(('external_ids', {'iface-id': 'fc66d61b-df87-483c-96a1-89033c9deaa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:2e:ad', 'vm-uuid': 'f7c9047c-00f3-4cb3-9290-6d118bda1c9c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:53 user nova-compute[75071]: INFO os_vif [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df')
Nov 29 13:19:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updated VIF entry in instance network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-87843a38-7a72-4195-a4c7-a98c6440bda6 req-742712e4-5c55-4f8b-9cb6-9c9f34a3ca88 service nova] Releasing lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No VIF found with MAC fa:16:3e:90:2e:ad, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:19:53 user nova-compute[75071]: INFO nova.compute.manager [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] instance snapshotting
Nov 29 13:19:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Beginning live snapshot process
Nov 29 13:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjpube2is/eceb92ff122e46eabcd1b461c947f281.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjpube2is/eceb92ff122e46eabcd1b461c947f281.delta 1073741824" returned: 0 in 0.068s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 13:19:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75071) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 13:19:54 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] UEFI support detected
Nov 29 13:19:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-changed-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Refreshing instance network info cache due to event network-changed-cf16aa7f-bd3e-4107-850f-37bae039432d. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] Acquiring lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] Acquired lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG nova.network.neutron [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Refreshing network info cache for port cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG nova.network.neutron [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updated VIF entry in instance network info cache for port cf16aa7f-bd3e-4107-850f-37bae039432d. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG nova.network.neutron [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updating instance_info_cache with network_info: [{"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e7ae0ef2-bf89-489a-8bf1-915476842beb req-cb460c2d-e878-49bd-824f-90f8471de84b service nova] Releasing lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:19:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:19:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] COPY block job progress, current cursor: 74252288 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:56 user nova-compute[75071]: WARNING nova.compute.manager [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received unexpected event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with vm_state building and task_state spawning.
Nov 29 13:19:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:19:56 user nova-compute[75071]: WARNING nova.compute.manager [req-2ff09aef-fd52-42ad-941d-961bda46b216 req-7c4a4074-d40a-4b70-960f-cfe4d4dc5033 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received unexpected event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with vm_state building and task_state spawning.
Nov 29 13:19:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:19:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 13:19:56 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjpube2is/eceb92ff122e46eabcd1b461c947f281.delta /opt/stack/data/nova/instances/snapshots/tmpjpube2is/eceb92ff122e46eabcd1b461c947f281 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjpube2is/eceb92ff122e46eabcd1b461c947f281.delta /opt/stack/data/nova/instances/snapshots/tmpjpube2is/eceb92ff122e46eabcd1b461c947f281" returned: 0 in 0.440s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Snapshot extracted, beginning image upload
Nov 29 13:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:19:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance spawned successfully.
Nov 29 13:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:19:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Creating image(s)
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Ensure instance console log exists: /opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Start _get_guest_xml network_info=[{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89d407c4-7e0e-4213-a2a2-99d547c42a4c', 'attached_at': '', 'detached_at': '', 'volume_id': '49892357-0234-42db-918a-026a37e4f1f1', 'serial': '49892357-0234-42db-918a-026a37e4f1f1'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'd718e3bc-6d6a-472c-ab5e-766d743df9e2', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:19:58 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lazy-loading 'flavor' on Instance uuid 014f79bb-e808-49e1-8d7a-c058b99c8377 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: INFO nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Took 7.89 seconds to spawn the instance on the hypervisor.
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34fc69f-6c33-4ae9-b45d-2a24dd54b184]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:19:58 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c2a50-9df9-498a-81aa-7fee7c0172e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1] added
Nov 29 13:19:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c8bea-bbd8-483a-9b6a-7f7fcca6ec63]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: INFO nova.compute.manager [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Took 8.85 seconds to build instance.
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380a500-1d1c-47e2-9f2c-87701a970d79]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCiILDgZ {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-128b54e5-1875-4847-9103-11c188d3dd91 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.957s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.222s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCiILDgZ" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb8bdb-28b9-4095-a3c1-3855cadba21b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uCiILDgZ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[432eb88a-abea-4ddc-984f-0f29015b17aa]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95658f6-6e24-4386-917d-582fc785ced4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed5d6fd-db7a-4c62-8310-cf3cc33c2c19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]
Nov 29 13:19:58 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.
Nov 29 13:19:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62b7da5-d280-4c4e-b7cc-7884a7a210bd]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:19:58 user nova-compute[75071]: INFO nova.compute.manager [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Attaching volume f5b1a30d-1d4d-4136-ac79-cd4ba2103037 to /dev/vdb
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0283c8-b555-457f-865b-49b4583d72eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:19:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc99a9-4952-41ef-a090-ce6d9191b54d]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.utils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1411aca9-f2dd-4128-b09d-c00ed9100e17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e025b2fb-5c37-49b4-b2bc-61d667b0ce1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b86fa2-30aa-4751-a44c-f1633d1fdca7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[182a57eb-a37e-48ea-a551-e8d7ed5049d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:19:58 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:19:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94638b5-32e7-47d0-8d84-529adefa0d84]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG os_brick.utils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:58 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updating existing volume attachment record: dd4549cb-3094-416c-8df5-2206aa88c9be {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23739633431303236', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739633431303236', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-878992995',display_name='tempest-TestShelveInstance-server-878992995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-878992995',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3l5psQ+RFAOK4Bmf81fxopedVDeR2Xv3emIdqPVEMZ4lQ3fRN6u7br81LSROFbo78BoT0QVP3ZpQw2is7bxCC+v9VSWxo9qONy36RA8t5MnIp983IR0xu8Al/0PDLpvQ==',key_name='tempest-TestShelveInstance-76113716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e33dac7a205d476ba368ab85fa20387d',ramdisk_id='',reservation_id='r-3amg8rr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-260027550',owner_user_name='tempest-TestShelveInstance-260027550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:38Z,user_data=None,user_id='754229134eaf4fd18d8b0680e74ddd90',uuid=89d407c4-7e0e-4213-a2a2-99d547c42a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converting VIF {"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'pci_devices' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:19:59 user nova-compute[75071]:   <uuid>89d407c4-7e0e-4213-a2a2-99d547c42a4c</uuid>
Nov 29 13:19:59 user nova-compute[75071]:   <name>instance-0000000a</name>
Nov 29 13:19:59 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:19:59 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:19:59 user nova-compute[75071]:   <metadata>
Nov 29 13:19:59 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:19:59 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:19:59 user nova-compute[75071]:       <nova:name>tempest-TestShelveInstance-server-878992995</nova:name>
Nov 29 13:19:59 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:19:58</nova:creationTime>
Nov 29 13:19:59 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:19:59 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:19:59 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:19:59 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:19:59 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:19:59 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:19:59 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:19:59 user nova-compute[75071]:       <nova:owner>
Nov 29 13:19:59 user nova-compute[75071]:         <nova:user uuid="754229134eaf4fd18d8b0680e74ddd90">tempest-TestShelveInstance-260027550-project-member</nova:user>
Nov 29 13:19:59 user nova-compute[75071]:         <nova:project uuid="e33dac7a205d476ba368ab85fa20387d">tempest-TestShelveInstance-260027550</nova:project>
Nov 29 13:19:59 user nova-compute[75071]:       </nova:owner>
Nov 29 13:19:59 user nova-compute[75071]:       <nova:ports>
Nov 29 13:19:59 user nova-compute[75071]:         <nova:port uuid="ebb73234-ca47-4314-a8e2-a16cce479217">
Nov 29 13:19:59 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 13:19:59 user nova-compute[75071]:         </nova:port>
Nov 29 13:19:59 user nova-compute[75071]:       </nova:ports>
Nov 29 13:19:59 user nova-compute[75071]:     </nova:instance>
Nov 29 13:19:59 user nova-compute[75071]:   </metadata>
Nov 29 13:19:59 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:19:59 user nova-compute[75071]:     <system>
Nov 29 13:19:59 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:19:59 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:19:59 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:19:59 user nova-compute[75071]:       <entry name="serial">89d407c4-7e0e-4213-a2a2-99d547c42a4c</entry>
Nov 29 13:19:59 user nova-compute[75071]:       <entry name="uuid">89d407c4-7e0e-4213-a2a2-99d547c42a4c</entry>
Nov 29 13:19:59 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:19:59 user nova-compute[75071]:     </system>
Nov 29 13:19:59 user nova-compute[75071]:   </sysinfo>
Nov 29 13:19:59 user nova-compute[75071]:   <os>
Nov 29 13:19:59 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:19:59 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:19:59 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:19:59 user nova-compute[75071]:   </os>
Nov 29 13:19:59 user nova-compute[75071]:   <features>
Nov 29 13:19:59 user nova-compute[75071]:     <acpi/>
Nov 29 13:19:59 user nova-compute[75071]:     <apic/>
Nov 29 13:19:59 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:19:59 user nova-compute[75071]:   </features>
Nov 29 13:19:59 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:19:59 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:19:59 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:19:59 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:19:59 user nova-compute[75071]:   </clock>
Nov 29 13:19:59 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:19:59 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:19:59 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:19:59 user nova-compute[75071]:   </cpu>
Nov 29 13:19:59 user nova-compute[75071]:   <devices>
Nov 29 13:19:59 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:19:59 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:19:59 user nova-compute[75071]:       <source dev="/dev/sde"/>
Nov 29 13:19:59 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:19:59 user nova-compute[75071]:       <serial>49892357-0234-42db-918a-026a37e4f1f1</serial>
Nov 29 13:19:59 user nova-compute[75071]:     </disk>
Nov 29 13:19:59 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:19:59 user nova-compute[75071]:       <mac address="fa:16:3e:49:68:09"/>
Nov 29 13:19:59 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:59 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:19:59 user nova-compute[75071]:       <target dev="tapebb73234-ca"/>
Nov 29 13:19:59 user nova-compute[75071]:     </interface>
Nov 29 13:19:59 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:19:59 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c/console.log" append="off"/>
Nov 29 13:19:59 user nova-compute[75071]:     </serial>
Nov 29 13:19:59 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:19:59 user nova-compute[75071]:     <video>
Nov 29 13:19:59 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:19:59 user nova-compute[75071]:     </video>
Nov 29 13:19:59 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:19:59 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:19:59 user nova-compute[75071]:     </rng>
Nov 29 13:19:59 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:19:59 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:19:59 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:19:59 user nova-compute[75071]:     </memballoon>
Nov 29 13:19:59 user nova-compute[75071]:   </devices>
Nov 29 13:19:59 user nova-compute[75071]: </domain>
Nov 29 13:19:59 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-878992995',display_name='tempest-TestShelveInstance-server-878992995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-878992995',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3l5psQ+RFAOK4Bmf81fxopedVDeR2Xv3emIdqPVEMZ4lQ3fRN6u7br81LSROFbo78BoT0QVP3ZpQw2is7bxCC+v9VSWxo9qONy36RA8t5MnIp983IR0xu8Al/0PDLpvQ==',key_name='tempest-TestShelveInstance-76113716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e33dac7a205d476ba368ab85fa20387d',ramdisk_id='',reservation_id='r-3amg8rr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-260027550',owner_user_name='tempest-TestShelveInstance-260027550-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:19:38Z,user_data=None,user_id='754229134eaf4fd18d8b0680e74ddd90',uuid=89d407c4-7e0e-4213-a2a2-99d547c42a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converting VIF {"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG os_vif [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b700fbc7-fbf0-58cc-bfd0-1378211f4379', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb73234-ca, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb73234-ca, col_values=(('qos', UUID('f4684fa3-1053-449e-9feb-b1105f0b78b5')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb73234-ca, col_values=(('external_ids', {'iface-id': 'ebb73234-ca47-4314-a8e2-a16cce479217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:68:09', 'vm-uuid': '89d407c4-7e0e-4213-a2a2-99d547c42a4c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:19:59 user nova-compute[75071]: INFO os_vif [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca')
Nov 29 13:20:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] No VIF found with MAC fa:16:3e:49:68:09, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:20:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Snapshot image upload complete
Nov 29 13:20:01 user nova-compute[75071]: INFO nova.compute.manager [None req-21683efb-938f-4161-a99a-129a453cad7c tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Took 8.40 seconds to snapshot the instance on the hypervisor.
Nov 29 13:20:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6487144-7197-4468-9194-075c6cb870a1 req-8b1ccf88-be52-49aa-8523-55fbd3a0e42d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6487144-7197-4468-9194-075c6cb870a1 req-8b1ccf88-be52-49aa-8523-55fbd3a0e42d service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6487144-7197-4468-9194-075c6cb870a1 req-8b1ccf88-be52-49aa-8523-55fbd3a0e42d service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6487144-7197-4468-9194-075c6cb870a1 req-8b1ccf88-be52-49aa-8523-55fbd3a0e42d service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6487144-7197-4468-9194-075c6cb870a1 req-8b1ccf88-be52-49aa-8523-55fbd3a0e42d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:02 user nova-compute[75071]: WARNING nova.compute.manager [req-c6487144-7197-4468-9194-075c6cb870a1 req-8b1ccf88-be52-49aa-8523-55fbd3a0e42d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received unexpected event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with vm_state building and task_state spawning.
Nov 29 13:20:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "interface-2a30460f-0839-4256-a3b8-0c6e170fbe4b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "interface-2a30460f-0839-4256-a3b8-0c6e170fbe4b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'flavor' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'pci_requests' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.objects.base [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Object Instance<2a30460f-0839-4256-a3b8-0c6e170fbe4b> lazy-loaded attributes: flavor,pci_requests {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.policy [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2620d9a6cc1b4f789bdb2cb0827fee65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd794844d6bd7438dba426da0c83eea2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:04 user nova-compute[75071]: WARNING nova.compute.manager [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received unexpected event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with vm_state building and task_state spawning.
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-changed-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Refreshing instance network info cache due to event network-changed-254915cd-7b23-4208-a5bf-af1133dc3493. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] Acquiring lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] Acquired lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Refreshing network info cache for port 254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:20:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance spawned successfully.
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:20:04 user nova-compute[75071]: INFO nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 29 13:20:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:20:04 user nova-compute[75071]: INFO nova.compute.manager [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Took 27.66 seconds to build instance.
Nov 29 13:20:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2daceb7-c260-4401-970a-ca07f9e1b47f tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.787s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updated VIF entry in instance network info cache for port 254915cd-7b23-4208-a5bf-af1133dc3493. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Successfully created port: 7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bfabfab-30b6-44a0-8891-c7dad95bd9e2 req-da3f411f-9b50-40a1-b3d9-44c1fa312dd0 service nova] Releasing lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Successfully updated port: 7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquired lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:20:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Releasing lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converting VIF {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG os_vif [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0665ee91-e2b5-52d7-9bad-b4ccb8ef0b28', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c0b9f9f-d2, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c0b9f9f-d2, col_values=(('qos', UUID('3fc8985a-eb51-4ed0-98ca-f3e03b5bec2d')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c0b9f9f-d2, col_values=(('external_ids', {'iface-id': '7c0b9f9f-d2f5-461e-af21-746f1e08a64b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:70:d3', 'vm-uuid': '2a30460f-0839-4256-a3b8-0c6e170fbe4b'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: INFO os_vif [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2')
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converting VIF {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] attach device xml: <interface type="ethernet">
Nov 29 13:20:06 user nova-compute[75071]:   <mac address="fa:16:3e:89:70:d3"/>
Nov 29 13:20:06 user nova-compute[75071]:   <model type="virtio"/>
Nov 29 13:20:06 user nova-compute[75071]:   <mtu size="1442"/>
Nov 29 13:20:06 user nova-compute[75071]:   <target dev="tap7c0b9f9f-d2"/>
Nov 29 13:20:06 user nova-compute[75071]: </interface>
Nov 29 13:20:06 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-changed-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Refreshing instance network info cache due to event network-changed-7c0b9f9f-d2f5-461e-af21-746f1e08a64b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] Acquiring lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] Acquired lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:20:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Refreshing network info cache for port 7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No VIF found with MAC fa:16:3e:8f:c5:4a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:20:07 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Nov 29 13:20:07 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:20:07 user nova-compute[75071]:   <nova:creationTime>2023-11-29 13:20:07</nova:creationTime>
Nov 29 13:20:07 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Nov 29 13:20:07 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Nov 29 13:20:07 user nova-compute[75071]:   </nova:flavor>
Nov 29 13:20:07 user nova-compute[75071]:   <nova:owner>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:20:07 user nova-compute[75071]:   </nova:owner>
Nov 29 13:20:07 user nova-compute[75071]:   <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:20:07 user nova-compute[75071]:   <nova:ports>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:20:07 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:20:07 user nova-compute[75071]:     </nova:port>
Nov 29 13:20:07 user nova-compute[75071]:     <nova:port uuid="7c0b9f9f-d2f5-461e-af21-746f1e08a64b">
Nov 29 13:20:07 user nova-compute[75071]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 29 13:20:07 user nova-compute[75071]:     </nova:port>
Nov 29 13:20:07 user nova-compute[75071]:   </nova:ports>
Nov 29 13:20:07 user nova-compute[75071]: </nova:instance>
Nov 29 13:20:07 user nova-compute[75071]:  {{(pid=75071) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updated VIF entry in instance network info cache for port 7c0b9f9f-d2f5-461e-af21-746f1e08a64b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2715fa4d-e434-4b67-9a16-da7f8fcf81c9 req-c4820248-5b32-42d8-b442-df01cc50ac5e service nova] Releasing lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5d69a244-f88e-4877-8b33-d067b97c2e89 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "interface-2a30460f-0839-4256-a3b8-0c6e170fbe4b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.392s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG nova.objects.instance [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'flavor' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:08 user nova-compute[75071]: INFO nova.compute.manager [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Attaching volume 407e6c6d-f2e2-4e1e-aa00-9c884293935d to /dev/vdb
Nov 29 13:20:08 user nova-compute[75071]: DEBUG os_brick.utils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5a287-b26b-4f7b-a65d-44c0e8c72edf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c102bb-eaf8-4da7-8302-d024016e4c23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f93af9-e258-4fa6-85f1-e072027d9a38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd4949-3222-4bf6-8ae0-0598b48c29c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:08 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffd98fb-e0e1-4c78-8cc1-f261a5a92219]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG os_brick.utils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating existing volume attachment record: a7b336f9-6033-4188-af61-99aa6d729367 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:08 user nova-compute[75071]: WARNING nova.compute.manager [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received unexpected event network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b for instance with vm_state active and task_state None.
Nov 29 13:20:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:08 user nova-compute[75071]: WARNING nova.compute.manager [req-93fdfd83-d986-458a-8788-982561b571f8 req-a219ae85-792f-464e-bbc3-23a1dca21f3d service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received unexpected event network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b for instance with vm_state active and task_state None.
Nov 29 13:20:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-changed-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Refreshing instance network info cache due to event network-changed-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] Acquiring lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] Acquired lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Refreshing network info cache for port c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lazy-loading 'flavor' on Instance uuid 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:10 user nova-compute[75071]: INFO nova.compute.manager [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Attaching volume b002d748-69aa-4424-a1b6-0ff69a6c797e to /dev/vdb
Nov 29 13:20:10 user nova-compute[75071]: DEBUG os_brick.utils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2297e15c-e70c-401a-88ec-c602dcd110b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c668778-2cc4-4511-9932-19cc48b2755f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5c46ac-9950-4e59-bc42-0c5db65a1242]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2739e69e-8828-4fb1-bde8-ee9b5e346b8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:10 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95769a9c-e378-4b77-95d3-d3b05cd45026]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG os_brick.utils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updating existing volume attachment record: cc543f69-09f7-4117-ae9e-1cfd19fb1c9f {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updated VIF entry in instance network info cache for port c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updating instance_info_cache with network_info: [{"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a88626c1-c1ed-4ef9-86e2-f58394daf4ad req-11c6c919-4c2c-41a2-b666-c597b8f0657f service nova] Releasing lock "refresh_cache-5664a867-ffa0-4aae-9794-ee14a7d91e5e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:20:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MToOEwUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:12 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:12 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:12 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260" returned: 21 in 0.041s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c7360f-53aa-4ca4-ab11-cfd35f7b2c3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:20:12 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9609d-a690-4d16-90d0-dd20decf932a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037] added
Nov 29 13:20:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a61c06-2ca2-4d60-8899-48154411fa9a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce50c50-3efc-4bb0-83c2-26c2434479da]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MToOEwUJ {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MToOEwUJ" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f681753-ae6b-46dc-9555-b9c890f03aaf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MToOEwUJ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f0eff-affc-4e7a-9b74-976a0d9bb040]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfdc5be-00dd-4faf-b77e-091f763993bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15584c77-a92d-4aac-a9d0-bfd0c453bf8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260]
Nov 29 13:20:12 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.104s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d049bd-7231-4d3b-a80c-e44c7b30980d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef943028-58c3-44e1-a388-4d91d46e4720]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.515s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc5e948-b6b0-4702-b4f5-3a2bd2fb2928]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:20:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MToOEwUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.577s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] <== connect_volume: return (1580ms) {'type': 'block', 'scsi_wwn': '23938316637643238', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938316637643238', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lazy-loading 'flavor' on Instance uuid 014f79bb-e808-49e1-8d7a-c058b99c8377 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:20:14 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:14 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:20:14 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:14 user nova-compute[75071]:   <serial>f5b1a30d-1d4d-4136-ac79-cd4ba2103037</serial>
Nov 29 13:20:14 user nova-compute[75071]: </disk>
Nov 29 13:20:14 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] No VIF found with MAC fa:16:3e:20:58:16, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:20:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-79ab50b3-bce9-440a-9fce-7b38cd5574ec tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.600s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:16 user nova-compute[75071]: INFO nova.compute.manager [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Detaching volume f5b1a30d-1d4d-4136-ac79-cd4ba2103037
Nov 29 13:20:16 user nova-compute[75071]: INFO nova.virt.block_device [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Attempting to driver detach volume f5b1a30d-1d4d-4136-ac79-cd4ba2103037 from mountpoint /dev/vdb
Nov 29 13:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Attempting to detach device vdb from instance 014f79bb-e808-49e1-8d7a-c058b99c8377 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:16 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:16 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:20:16 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:16 user nova-compute[75071]:   <serial>f5b1a30d-1d4d-4136-ac79-cd4ba2103037</serial>
Nov 29 13:20:16 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:20:16 user nova-compute[75071]: </disk>
Nov 29 13:20:16 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Successfully detached device vdb from instance 014f79bb-e808-49e1-8d7a-c058b99c8377 from the persistent domain config.
Nov 29 13:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 014f79bb-e808-49e1-8d7a-c058b99c8377 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:16 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:16 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:20:16 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:16 user nova-compute[75071]:   <serial>f5b1a30d-1d4d-4136-ac79-cd4ba2103037</serial>
Nov 29 13:20:16 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:20:16 user nova-compute[75071]: </disk>
Nov 29 13:20:16 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgtLGyFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:16 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0f9afb-b3d9-4db0-965f-370f3f42c839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:20:16 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a956c9e-6a07-464d-88b2-6f21f179de2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d] added
Nov 29 13:20:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[133eaa14-4427-409d-a6f7-18b79f048960]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff64cb7-0bea-4faa-8902-e551f7748dc4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgtLGyFa {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgtLGyFa" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e77dd4-b2b5-480a-9c4c-164514167952]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgtLGyFa'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa7568-f811-4312-bc9b-c20a461174bf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a4752-5b83-4f7d-bb14-a811d9fc7bb2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 014f79bb-e808-49e1-8d7a-c058b99c8377 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e960c8d9-98c9-4bd4-a43e-d0f66f225c35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260]
Nov 29 13:20:17 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90444022-95ff-48c4-ada9-61ceb0b0a6e2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abfaead-e193-46d1-abbc-b42dc096d39e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:17 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8dbb11-9a59-4655-ac2a-1841a152c608]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:20:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgtLGyFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23034616238326138', 'path': '/dev/sdg'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034616238326138', 'path': '/dev/sdg'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'flavor' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:20:18 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:18 user nova-compute[75071]:   <source dev="/dev/sdg"/>
Nov 29 13:20:18 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:18 user nova-compute[75071]:   <serial>407e6c6d-f2e2-4e1e-aa00-9c884293935d</serial>
Nov 29 13:20:18 user nova-compute[75071]: </disk>
Nov 29 13:20:18 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:18 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:18 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:18 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] No VIF found with MAC fa:16:3e:8f:c5:4a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc86e62-3995-43f4-a1c2-b6863ca921b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:20:18 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd0c30c-b256-4f55-9459-5f1164719b40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e] added
Nov 29 13:20:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c533b70-6799-41e5-b875-75257183507f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4596e474-d7f0-49b0-882a-46650c70cb77]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AocnrNSw {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AocnrNSw" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b776a2ac-46b4-4cb2-8886-1b9ebaf6c53d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AocnrNSw'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5559218a-291d-49a1-860b-5d68656549c8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58d151b-791f-476d-91cd-9a120e2499ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:18 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-54e017e6-244c-4d09-ba65-3374593cfe63 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.733s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1840a29-b66d-40ab-96a8-d4924f42f557]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]
Nov 29 13:20:18 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e84855e-4f49-4464-821e-c3f8a6e7f378]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7a0680-2efa-4d46-b175-9dfb4594de40]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:19 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0882915b-f592-4227-ad3a-01085abd33c0]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:20:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23661373137313162', 'path': '/dev/sdh'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661373137313162', 'path': '/dev/sdh'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lazy-loading 'flavor' on Instance uuid 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:20:20 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:20 user nova-compute[75071]:   <source dev="/dev/sdh"/>
Nov 29 13:20:20 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:20 user nova-compute[75071]:   <serial>b002d748-69aa-4424-a1b6-0ff69a6c797e</serial>
Nov 29 13:20:20 user nova-compute[75071]: </disk>
Nov 29 13:20:20 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:20 user nova-compute[75071]: INFO nova.compute.manager [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Detaching volume 407e6c6d-f2e2-4e1e-aa00-9c884293935d
Nov 29 13:20:20 user nova-compute[75071]: INFO nova.virt.block_device [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Attempting to driver detach volume 407e6c6d-f2e2-4e1e-aa00-9c884293935d from mountpoint /dev/vdb
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Attempting to detach device vdb from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:20 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:20 user nova-compute[75071]:   <source dev="/dev/sdg"/>
Nov 29 13:20:20 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:20 user nova-compute[75071]:   <serial>407e6c6d-f2e2-4e1e-aa00-9c884293935d</serial>
Nov 29 13:20:20 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 13:20:20 user nova-compute[75071]: </disk>
Nov 29 13:20:20 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully detached device vdb from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the persistent domain config.
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:20 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:20 user nova-compute[75071]:   <source dev="/dev/sdg"/>
Nov 29 13:20:20 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:20 user nova-compute[75071]:   <serial>407e6c6d-f2e2-4e1e-aa00-9c884293935d</serial>
Nov 29 13:20:20 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 13:20:20 user nova-compute[75071]: </disk>
Nov 29 13:20:20 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] No VIF found with MAC fa:16:3e:20:96:a8, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5484a65a-d6ad-4300-ae6e-060de6613d38 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.576s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:20:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-changed-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Refreshing instance network info cache due to event network-changed-d9af1c93-0d38-4750-82e0-caceb792b969. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] Acquiring lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] Acquired lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:20:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Refreshing network info cache for port d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc638027-b8dd-48e7-81dd-64605535ad45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0feaa1-6922-4ec6-942a-9ced4e196b3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71635d11-b3a5-4ea7-ba76-3f75061cc59f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e10053-7b5e-46db-972e-6e199cf79e16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:22 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8c0dff-895b-4ce4-9a2e-b33c11637f97]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lazy-loading 'flavor' on Instance uuid b3791790-3607-48cc-a6f3-d7eceedc6c88 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:22 user nova-compute[75071]: INFO nova.compute.manager [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Swapping volume b002d748-69aa-4424-a1b6-0ff69a6c797e for 93856c37-436e-4121-bff2-c8135d84d1e3
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updated VIF entry in instance network info cache for port d9af1c93-0d38-4750-82e0-caceb792b969. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updating instance_info_cache with network_info: [{"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-45e5b0e2-d57d-475c-ab7f-4b7c6f0d805f req-fb436fa2-3e17-4239-90cc-1cc5cda5fbf3 service nova] Releasing lock "refresh_cache-b3791790-3607-48cc-a6f3-d7eceedc6c88" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:22 user nova-compute[75071]: INFO nova.compute.manager [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Attaching volume d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e to /dev/vdb
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3e5603-7298-4267-b0d8-c6ae4694a426]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe73df6c-5326-482a-a730-050e313918ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6e3c47-8356-42a5-8bfe-b40ca218943f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd94f55-f08a-4cf9-8800-131473141f22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:22 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:20:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e7caab-a9e4-4ac6-af60-adbb895f295a]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:22 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updating existing volume attachment record: 4df7af2f-a872-4173-a997-b4278e43de19 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:20:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMuwldXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5664a867-ffa0-4aae-9794-ee14a7d91e5e', 'attached_at': '', 'detached_at': '', 'volume_id': '93856c37-436e-4121-bff2-c8135d84d1e3', 'serial': '93856c37-436e-4121-bff2-c8135d84d1e3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '5664a867-ffa0-4aae-9794-ee14a7d91e5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b002d748-69aa-4424-a1b6-0ff69a6c797e', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMuwldXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:30 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260" returned: 21 in 0.066s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d7838-d63a-4448-b11a-5b539b431720]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:20:30 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[582da9f6-73c2-41b7-aa46-2141be458fe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3] added
Nov 29 13:20:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76babb06-68ef-4a40-85c0-47090c80a67c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f540959-a5b8-4525-a29d-360311ccddbc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMuwldXK {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CMuwldXK" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cedf07f-853e-4c17-bb7c-7bf42d6e1994]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CMuwldXK'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04795de7-589a-4e97-92ce-b7ab23820f18]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[819eb885-845b-47e7-9b9d-8d7f84bbb70f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed3327-66c0-4de3-8bac-bf48ae38e184]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260]
Nov 29 13:20:30 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a296bcd-a421-43b1-83b6-e7e5852e1022]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc9148-3cb9-48e9-9cfd-efe7d54421c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:30 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e031a8-51e1-45b7-aeec-3339468a9b79]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:20:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMuwldXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:20:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:20:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBcxkRJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23738346539653337', 'path': '/dev/sdi'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738346539653337', 'path': '/dev/sdi'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.927s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:32 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:32 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lazy-loading 'flavor' on Instance uuid 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d00d099-ffd6-4331-a68a-c3dc65d9c66d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:20:32 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54d43f5-5bec-465a-ac2c-2d6685ae2d23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e] added
Nov 29 13:20:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8304f3-81a0-4100-9501-5bf07ee32efc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2bcc53-5b9f-4dcc-bea3-18bf14ab2868]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBcxkRJP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBcxkRJP" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f11d66b-5188-4e50-8383-e5479afc6ff0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SBcxkRJP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[863e534c-d9f0-4218-b71c-0158e246468c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7b3adb-bbd4-478a-820a-2e3d33c0b2d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b416f6-39f8-4293-b16b-cd44593e5616]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260]
Nov 29 13:20:32 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb7634b-7de6-41c4-9533-1289c36d0124]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2cdb5f-7e16-4a53-97b3-225457f2bccf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:32 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be22d1-1ab0-4f63-bca1-49eef662d5e4]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBcxkRJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:20:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 153092096 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] <== connect_volume: return (2289ms) {'type': 'block', 'scsi_wwn': '23339666338353831', 'path': '/dev/sdj'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339666338353831', 'path': '/dev/sdj'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lazy-loading 'flavor' on Instance uuid b3791790-3607-48cc-a6f3-d7eceedc6c88 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 13:20:33 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:33 user nova-compute[75071]:   <source dev="/dev/sdj"/>
Nov 29 13:20:33 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:33 user nova-compute[75071]:   <serial>d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e</serial>
Nov 29 13:20:33 user nova-compute[75071]: </disk>
Nov 29 13:20:33 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:20:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] No VIF found with MAC fa:16:3e:ff:e7:bb, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:20:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 502267904 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e72305f-b92f-498c-9e29-5273c0ef8e8c tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.698s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 665845760 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] volume_snapshot_create: create_info: {'snapshot_id': 'c7d3a4cc-668e-4b78-b846-89e9e3df1cc2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75071) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 13:20:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] snap xml: <domainsnapshot>
Nov 29 13:20:34 user nova-compute[75071]:   <disks>
Nov 29 13:20:34 user nova-compute[75071]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 29 13:20:34 user nova-compute[75071]:       <source file="/dev/new_file"/>
Nov 29 13:20:34 user nova-compute[75071]:     </disk>
Nov 29 13:20:34 user nova-compute[75071]:     <disk name="vda" snapshot="no"/>
Nov 29 13:20:34 user nova-compute[75071]:   </disks>
Nov 29 13:20:34 user nova-compute[75071]: </domainsnapshot>
Nov 29 13:20:34 user nova-compute[75071]:  {{(pid=75071) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 13:20:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] Lazy-loading 'system_metadata' on Instance uuid b3791790-3607-48cc-a6f3-d7eceedc6c88 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     rv = execute(f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     six.reraise(c, e, tb)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     raise value
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     rv = meth(*args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     self._volume_snapshot_create(context, instance, guest,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     rv = execute(f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     six.reraise(c, e, tb)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     raise value
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     rv = meth(*args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] 
Nov 29 13:20:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-55c3882c-fd64-40dd-a0ea-aa4f0d26124a tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] volume_snapshot_delete: delete_info: {'volume_id': 'd4755ace-37fe-421c-ab7d-a8ab2dbf6d8e'} {{(pid=75071) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-55c3882c-fd64-40dd-a0ea-aa4f0d26124a tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88]     if delete_info['type'] != 'qcow2':
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] KeyError: 'type'
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-55c3882c-fd64-40dd-a0ea-aa4f0d26124a tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-1a16fa95-8d32-4abe-9673-ea4a3ca6c692)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot c7d3a4cc-668e-4b78-b846-89e9e3df1cc2 could not be found.
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot c7d3a4cc-668e-4b78-b846-89e9e3df1cc2 could not be found. (HTTP 404) (Request-ID: req-7d5f5514-3e55-4312-821c-86689a063f81)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot c7d3a4cc-668e-4b78-b846-89e9e3df1cc2 could not be found.
Nov 29 13:20:34 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server [None req-cfec8454-3b02-4bd5-b150-323077f072f0 tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server 
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server [None req-55c3882c-fd64-40dd-a0ea-aa4f0d26124a tempest-VolumesAssistedSnapshotsTest-1463933590 tempest-VolumesAssistedSnapshotsTest-1463933590-project] Exception during message handling: KeyError: 'type'
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 13:20:34 user nova-compute[75071]: ERROR oslo_messaging.rpc.server 
Nov 29 13:20:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 802160640 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:35 user nova-compute[75071]: INFO nova.compute.manager [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Detaching volume d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 951058432 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:35 user nova-compute[75071]: INFO nova.virt.block_device [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Attempting to driver detach volume d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e from mountpoint /dev/vdb
Nov 29 13:20:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Attempting to detach device vdb from instance b3791790-3607-48cc-a6f3-d7eceedc6c88 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:20:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:35 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:35 user nova-compute[75071]:   <source dev="/dev/sdj"/>
Nov 29 13:20:35 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:35 user nova-compute[75071]:   <serial>d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e</serial>
Nov 29 13:20:35 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:20:35 user nova-compute[75071]: </disk>
Nov 29 13:20:35 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Successfully detached device vdb from instance b3791790-3607-48cc-a6f3-d7eceedc6c88 from the persistent domain config.
Nov 29 13:20:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3791790-3607-48cc-a6f3-d7eceedc6c88 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:20:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:35 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:35 user nova-compute[75071]:   <source dev="/dev/sdj"/>
Nov 29 13:20:35 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:35 user nova-compute[75071]:   <serial>d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e</serial>
Nov 29 13:20:35 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:20:35 user nova-compute[75071]: </disk>
Nov 29 13:20:35 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 1029701632 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3791790-3607-48cc-a6f3-d7eceedc6c88 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6adf198-cf40-4262-8bed-7a93eec36504]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:36 user nova-compute[75071]: No targets found.
Nov 29 13:20:36 user nova-compute[75071]: iSNS:
Nov 29 13:20:36 user nova-compute[75071]: No targets found.
Nov 29 13:20:36 user nova-compute[75071]: STATIC:
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:36 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:36 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:36 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:36 user nova-compute[75071]: No targets found.
Nov 29 13:20:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:36 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:36 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[995d39cf-08ab-479f-8695-85e927bf619e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6570b-d4a9-4685-b020-232503768d2d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:36 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148427d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e'): ({'sdh'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Removing single pathed devices sdh {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdbb59d-3323-4cf7-8685-ea7ff616eb83]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd345b-b5dd-42b3-97de-c9bf97abf3fb]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Flushing IO for device /dev/sdh {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b47009-622e-471c-8c50-eb8f84907149]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670b6fc-197a-4337-bdee-5ab733db947d]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed40f4e-4bb3-43a3-b6e1-975fbe28ce79]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 014f79bb-e808-49e1-8d7a-c058b99c8377 is timed out.
Nov 29 13:20:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Successfully detached device vdb from instance 014f79bb-e808-49e1-8d7a-c058b99c8377 from the live domain config.
Nov 29 13:20:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MToOEwUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:37 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1336893a-014b-4707-a387-35d8acde2352]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]
Nov 29 13:20:37 user nova-compute[75071]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03e50e5-acad-4645-9cac-497a6c48b6dc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] <== disconnect_volume: return (343ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.095s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[824406b2-cb8e-4bfe-a7e3-afede0644cc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:37 user nova-compute[75071]: No targets found.
Nov 29 13:20:37 user nova-compute[75071]: iSNS:
Nov 29 13:20:37 user nova-compute[75071]: No targets found.
Nov 29 13:20:37 user nova-compute[75071]: STATIC:
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:37 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:37 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:37 user nova-compute[75071]: No targets found.
Nov 29 13:20:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:37 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:37 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23a08c1-cc65-4edc-a1d0-e1b20888471e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMuwldXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '5664a867-ffa0-4aae-9794-ee14a7d91e5e', 'attached_at': '', 'detached_at': '', 'volume_id': '93856c37-436e-4121-bff2-c8135d84d1e3', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] swap_volume: removing Cinder connection for volume b002d748-69aa-4424-a1b6-0ff69a6c797e {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f9373d-929a-471e-bcc9-abe410448395]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:37 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124facc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d7e42-0940-4a07-b169-b5091095465f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf99664-f60d-44d5-b532-0a943baedca3]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee54d97c-26b4-460e-8cfa-0c092d7b4eae]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbbf65c-bb23-4f42-b715-c4055085db62]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84dff4e-6b19-482a-b017-2d12522d8c46]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe52705-6cc8-4d78-8b1b-ec6749f5436b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260]
Nov 29 13:20:37 user nova-compute[75071]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b1a30d-1d4d-4136-ac79-cd4ba2103037 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f5f816-51f2-4c92-9fd3-1e0a454f3551]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] <== disconnect_volume: return (446ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:20:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] swap_volume: Updating volume b002d748-69aa-4424-a1b6-0ff69a6c797e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "CMuwldXK", "auth_password": "aTBuDmLsgzICcb", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "93856c37-436e-4121-bff2-c8135d84d1e3"}, "status": "reserved", "instance": "5664a867-ffa0-4aae-9794-ee14a7d91e5e", "attached_at": "", "detached_at": "", "volume_id": "93856c37-436e-4121-bff2-c8135d84d1e3", "serial": "93856c37-436e-4121-bff2-c8135d84d1e3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '93856c37-436e-4121-bff2-c8135d84d1e3', 'no_device': None, 'attachment_id': 'd680f84c-b55d-4fc0-b077-a2e9e7441709'} {{(pid=75071) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 13:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-69158120-4fe1-47c5-b6bf-c2471114661d tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.452s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lazy-loading 'flavor' on Instance uuid 014f79bb-e808-49e1-8d7a-c058b99c8377 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e1155a03-a2f0-40b0-9a95-9ddaf7837ae5 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.223s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG os_brick.utils [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc34cbc3-6e42-47ad-b258-39c17f2453c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d940d0d-4ff6-4e6a-8542-9e32f8929810]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88e60b-d578-4258-b67c-257a774474ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7602f431-1864-46e9-92f7-c2aac840b8fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:20:39 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa9c27e-c714-4bc1-9bff-22c6cf2fc6ba]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG os_brick.utils [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:39 user nova-compute[75071]: INFO nova.compute.manager [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Swapping volume 93856c37-436e-4121-bff2-c8135d84d1e3 for b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b is timed out.
Nov 29 13:20:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully detached device vdb from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the live domain config.
Nov 29 13:20:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgtLGyFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bee67a9-73d2-4450-b75f-9a9223268ce0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:40 user nova-compute[75071]: No targets found.
Nov 29 13:20:40 user nova-compute[75071]: iSNS:
Nov 29 13:20:40 user nova-compute[75071]: No targets found.
Nov 29 13:20:40 user nova-compute[75071]: STATIC:
Nov 29 13:20:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43
Nov 29 13:20:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d
Nov 29 13:20:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3
Nov 29 13:20:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2
Nov 29 13:20:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5
Nov 29 13:20:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:40 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:40 user nova-compute[75071]: No targets found.
Nov 29 13:20:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:40 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:40 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93c49d4-96ec-47f1-8e6f-577276b69930]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba372b66-5ecd-4803-a38f-91e10dedace4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d (non-flash)
Nov 29 13:20:40 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148352170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d'): ({'sdg'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Removing single pathed devices sdg {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5013851d-0969-4f54-a3f8-ae69c45c286a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a9d10-a6a2-4898-90c3-84f54631703d]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Flushing IO for device /dev/sdg {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.011s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72722544-4d85-4e87-b4b5-0126c96793af]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dac706-11e9-4203-ba1f-68aeccc93a20]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[82670696-6684-46d3-9fa9-d9a12dfba431]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c14d228-7af0-47d8-b36d-9b4da83d7692]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260]
Nov 29 13:20:41 user nova-compute[75071]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:41 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:407e6c6d-f2e2-4e1e-aa00-9c884293935d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ce2c77-7692-4b94-8a30-cc2009c88605]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] <== disconnect_volume: return (376ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:20:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=6804MB free_disk=25.308860778808594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 014f79bb-e808-49e1-8d7a-c058b99c8377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b3791790-3607-48cc-a6f3-d7eceedc6c88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 18f92aca-b5d2-4297-a767-e80a5dd92e42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 89d407c4-7e0e-4213-a2a2-99d547c42a4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9ad6a28c-21f9-468a-b81a-5d1b75e78ede actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:20:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:20:45 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:20:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:20:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6935d835-c98f-4355-8031-4436125925f1] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:20:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'flavor' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8d3d5246-790f-408d-ac5e-32d95e0431f3 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.600s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5664a867-ffa0-4aae-9794-ee14a7d91e5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b002d748-69aa-4424-a1b6-0ff69a6c797e', 'serial': 'b002d748-69aa-4424-a1b6-0ff69a6c797e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMuwldXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '93856c37-436e-4121-bff2-c8135d84d1e3'}, 'status': 'reserved', 'instance': '5664a867-ffa0-4aae-9794-ee14a7d91e5e', 'attached_at': '', 'detached_at': '', 'volume_id': '93856c37-436e-4121-bff2-c8135d84d1e3', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 13:20:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:47 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:47 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:47 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c59a32-a2b6-4000-a8c7-ce3cc9d03504]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:20:48 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a89efb-a68a-432b-bc2f-6454573ab3ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e] added
Nov 29 13:20:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd77c49-88df-41e6-b649-416309d78622]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea9122-5df4-4a40-ba9e-0b328a841cbc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AocnrNSw {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AocnrNSw" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f3eb1-8a3a-4e5f-860c-18d8d5da65bc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AocnrNSw'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e847fe-c718-44f7-bfa9-cac8f2c942a0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef22f0-280b-4447-83ad-99b44bddc65a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95553ee2-0398-4735-9a4e-96b37b2c3521]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]
Nov 29 13:20:48 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648e792-9fdb-4f77-bd50-e3e5ff2249a8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "interface-2a30460f-0839-4256-a3b8-0c6e170fbe4b-7c0b9f9f-d2f5-461e-af21-746f1e08a64b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "interface-2a30460f-0839-4256-a3b8-0c6e170fbe4b-7c0b9f9f-d2f5-461e-af21-746f1e08a64b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e100e5-45fe-4be4-9b16-d4dcf12050d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'flavor' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e4f322-a1ca-45dd-9e68-799f09d9c302]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converting VIF {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Attempting to detach device tap7c0b9f9f-d2 from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] detach device xml: <interface type="ethernet">
Nov 29 13:20:48 user nova-compute[75071]:   <mac address="fa:16:3e:89:70:d3"/>
Nov 29 13:20:48 user nova-compute[75071]:   <model type="virtio"/>
Nov 29 13:20:48 user nova-compute[75071]:   <mtu size="1442"/>
Nov 29 13:20:48 user nova-compute[75071]:   <target dev="tap7c0b9f9f-d2"/>
Nov 29 13:20:48 user nova-compute[75071]: </interface>
Nov 29 13:20:48 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 13:20:48 user nova-compute[75071]:   <name>instance-00000006</name>
Nov 29 13:20:48 user nova-compute[75071]:   <uuid>2a30460f-0839-4256-a3b8-0c6e170fbe4b</uuid>
Nov 29 13:20:48 user nova-compute[75071]:   <metadata>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:20:48 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Nov 29 13:20:48 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:20:48 user nova-compute[75071]:   <nova:creationTime>2023-11-29 13:20:07</nova:creationTime>
Nov 29 13:20:48 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Nov 29 13:20:48 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Nov 29 13:20:48 user nova-compute[75071]:   </nova:flavor>
Nov 29 13:20:48 user nova-compute[75071]:   <nova:owner>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:20:48 user nova-compute[75071]:   </nova:owner>
Nov 29 13:20:48 user nova-compute[75071]:   <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:20:48 user nova-compute[75071]:   <nova:ports>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:20:48 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:20:48 user nova-compute[75071]:     </nova:port>
Nov 29 13:20:48 user nova-compute[75071]:     <nova:port uuid="7c0b9f9f-d2f5-461e-af21-746f1e08a64b">
Nov 29 13:20:48 user nova-compute[75071]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 29 13:20:48 user nova-compute[75071]:     </nova:port>
Nov 29 13:20:48 user nova-compute[75071]:   </nova:ports>
Nov 29 13:20:48 user nova-compute[75071]: </nova:instance>
Nov 29 13:20:48 user nova-compute[75071]:   </metadata>
Nov 29 13:20:48 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Nov 29 13:20:48 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 13:20:48 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Nov 29 13:20:48 user nova-compute[75071]:   <resource>
Nov 29 13:20:48 user nova-compute[75071]:     <partition>/machine</partition>
Nov 29 13:20:48 user nova-compute[75071]:   </resource>
Nov 29 13:20:48 user nova-compute[75071]:   <sysinfo type='smbios'>
Nov 29 13:20:48 user nova-compute[75071]:     <system>
Nov 29 13:20:48 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 13:20:48 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 13:20:48 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Nov 29 13:20:48 user nova-compute[75071]:       <entry name='serial'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:20:48 user nova-compute[75071]:       <entry name='uuid'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:20:48 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Nov 29 13:20:48 user nova-compute[75071]:     </system>
Nov 29 13:20:48 user nova-compute[75071]:   </sysinfo>
Nov 29 13:20:48 user nova-compute[75071]:   <os>
Nov 29 13:20:48 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 13:20:48 user nova-compute[75071]:     <boot dev='hd'/>
Nov 29 13:20:48 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Nov 29 13:20:48 user nova-compute[75071]:   </os>
Nov 29 13:20:48 user nova-compute[75071]:   <features>
Nov 29 13:20:48 user nova-compute[75071]:     <acpi/>
Nov 29 13:20:48 user nova-compute[75071]:     <apic/>
Nov 29 13:20:48 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Nov 29 13:20:48 user nova-compute[75071]:   </features>
Nov 29 13:20:48 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 13:20:48 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Nov 29 13:20:48 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 13:20:48 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Nov 29 13:20:48 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Nov 29 13:20:48 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Nov 29 13:20:48 user nova-compute[75071]:   </cpu>
Nov 29 13:20:48 user nova-compute[75071]:   <clock offset='utc'>
Nov 29 13:20:48 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 13:20:48 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 13:20:48 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Nov 29 13:20:48 user nova-compute[75071]:   </clock>
Nov 29 13:20:48 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Nov 29 13:20:48 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Nov 29 13:20:48 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Nov 29 13:20:48 user nova-compute[75071]:   <devices>
Nov 29 13:20:48 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 13:20:48 user nova-compute[75071]:     <disk type='file' device='disk'>
Nov 29 13:20:48 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 13:20:48 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk' index='2'/>
Nov 29 13:20:48 user nova-compute[75071]:       <backingStore type='file' index='3'>
Nov 29 13:20:48 user nova-compute[75071]:         <format type='raw'/>
Nov 29 13:20:48 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3'/>
Nov 29 13:20:48 user nova-compute[75071]:         <backingStore/>
Nov 29 13:20:48 user nova-compute[75071]:       </backingStore>
Nov 29 13:20:48 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </disk>
Nov 29 13:20:48 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Nov 29 13:20:48 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 13:20:48 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config' index='1'/>
Nov 29 13:20:48 user nova-compute[75071]:       <backingStore/>
Nov 29 13:20:48 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Nov 29 13:20:48 user nova-compute[75071]:       <readonly/>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </disk>
Nov 29 13:20:48 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='usb'/>
Nov 29 13:20:48 user nova-compute[75071]:     </controller>
Nov 29 13:20:48 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='pci.0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </controller>
Nov 29 13:20:48 user nova-compute[75071]:     <controller type='ide' index='0'>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='ide'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 13:20:48 user nova-compute[75071]:     </controller>
Nov 29 13:20:48 user nova-compute[75071]:     <interface type='ethernet'>
Nov 29 13:20:48 user nova-compute[75071]:       <mac address='fa:16:3e:8f:c5:4a'/>
Nov 29 13:20:48 user nova-compute[75071]:       <target dev='tap254915cd-7b'/>
Nov 29 13:20:48 user nova-compute[75071]:       <model type='virtio'/>
Nov 29 13:20:48 user nova-compute[75071]:       <mtu size='1442'/>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='net0'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </interface>
Nov 29 13:20:48 user nova-compute[75071]:     <interface type='ethernet'>
Nov 29 13:20:48 user nova-compute[75071]:       <mac address='fa:16:3e:89:70:d3'/>
Nov 29 13:20:48 user nova-compute[75071]:       <target dev='tap7c0b9f9f-d2'/>
Nov 29 13:20:48 user nova-compute[75071]:       <model type='virtio'/>
Nov 29 13:20:48 user nova-compute[75071]:       <mtu size='1442'/>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='net1'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </interface>
Nov 29 13:20:48 user nova-compute[75071]:     <serial type='pty'>
Nov 29 13:20:48 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:20:48 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:20:48 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Nov 29 13:20:48 user nova-compute[75071]:         <model name='isa-serial'/>
Nov 29 13:20:48 user nova-compute[75071]:       </target>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </serial>
Nov 29 13:20:48 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 13:20:48 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:20:48 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:20:48 user nova-compute[75071]:       <target type='serial' port='0'/>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </console>
Nov 29 13:20:48 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='input0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </input>
Nov 29 13:20:48 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='input1'/>
Nov 29 13:20:48 user nova-compute[75071]:     </input>
Nov 29 13:20:48 user nova-compute[75071]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 13:20:48 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </graphics>
Nov 29 13:20:48 user nova-compute[75071]:     <audio id='1' type='none'/>
Nov 29 13:20:48 user nova-compute[75071]:     <video>
Nov 29 13:20:48 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='video0'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </video>
Nov 29 13:20:48 user nova-compute[75071]:     <memballoon model='virtio'>
Nov 29 13:20:48 user nova-compute[75071]:       <stats period='10'/>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='balloon0'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </memballoon>
Nov 29 13:20:48 user nova-compute[75071]:     <rng model='virtio'>
Nov 29 13:20:48 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Nov 29 13:20:48 user nova-compute[75071]:       <alias name='rng0'/>
Nov 29 13:20:48 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 13:20:48 user nova-compute[75071]:     </rng>
Nov 29 13:20:48 user nova-compute[75071]:   </devices>
Nov 29 13:20:48 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 13:20:48 user nova-compute[75071]:     <label>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</label>
Nov 29 13:20:48 user nova-compute[75071]:     <imagelabel>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</imagelabel>
Nov 29 13:20:48 user nova-compute[75071]:   </seclabel>
Nov 29 13:20:48 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 13:20:48 user nova-compute[75071]:     <label>+64055:+108</label>
Nov 29 13:20:48 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 13:20:48 user nova-compute[75071]:   </seclabel>
Nov 29 13:20:48 user nova-compute[75071]: </domain>
Nov 29 13:20:48 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 13:20:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully detached device tap7c0b9f9f-d2 from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the persistent domain config.
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] (1/8): Attempting to detach device tap7c0b9f9f-d2 with device alias net1 from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] detach device xml: <interface type="ethernet">
Nov 29 13:20:48 user nova-compute[75071]:   <mac address="fa:16:3e:89:70:d3"/>
Nov 29 13:20:48 user nova-compute[75071]:   <model type="virtio"/>
Nov 29 13:20:48 user nova-compute[75071]:   <mtu size="1442"/>
Nov 29 13:20:48 user nova-compute[75071]:   <target dev="tap7c0b9f9f-d2"/>
Nov 29 13:20:48 user nova-compute[75071]: </interface>
Nov 29 13:20:48 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Start waiting for the detach event from libvirt for device tap7c0b9f9f-d2 with device alias net1 for instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-54957e14-45b7-4446-b290-eb543dcdb20c req-0c7cbb2e-bb10-4cce-8dd9-f0ed18c13f8f service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-unplugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54957e14-45b7-4446-b290-eb543dcdb20c req-0c7cbb2e-bb10-4cce-8dd9-f0ed18c13f8f service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54957e14-45b7-4446-b290-eb543dcdb20c req-0c7cbb2e-bb10-4cce-8dd9-f0ed18c13f8f service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54957e14-45b7-4446-b290-eb543dcdb20c req-0c7cbb2e-bb10-4cce-8dd9-f0ed18c13f8f service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-54957e14-45b7-4446-b290-eb543dcdb20c req-0c7cbb2e-bb10-4cce-8dd9-f0ed18c13f8f service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-unplugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:48 user nova-compute[75071]: WARNING nova.compute.manager [req-54957e14-45b7-4446-b290-eb543dcdb20c req-0c7cbb2e-bb10-4cce-8dd9-f0ed18c13f8f service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received unexpected event network-vif-unplugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b for instance with vm_state active and task_state None.
Nov 29 13:20:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23661373137313162', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661373137313162', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:20:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lazy-loading 'flavor' on Instance uuid 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 363855872 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:50 user nova-compute[75071]: WARNING nova.compute.manager [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received unexpected event network-vif-plugged-7c0b9f9f-d2f5-461e-af21-746f1e08a64b for instance with vm_state active and task_state None.
Nov 29 13:20:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-changed-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing instance network info cache due to event network-changed-bebccb20-85a0-41c5-a67f-7bbc1ab30f97. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] Acquiring lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] Acquired lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:20:50 user nova-compute[75071]: DEBUG nova.network.neutron [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Refreshing network info cache for port bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:20:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updated VIF entry in instance network info cache for port bebccb20-85a0-41c5-a67f-7bbc1ab30f97. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:20:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [{"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c8753fa-b6ff-4b93-95e7-8d9c8b918631 req-13042cfb-4868-4e11-8963-80a30e1ca736 service nova] Releasing lock "refresh_cache-18f92aca-b5d2-4297-a767-e80a5dd92e42" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:20:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 629145600 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 941621248 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:52 user nova-compute[75071]: INFO nova.compute.manager [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Terminating instance
Nov 29 13:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 1062207488 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-00539926-c811-47f0-8062-1bfca91afa5e req-e6c5a642-1c67-4db9-ab6a-bdeabe717cbe service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-00539926-c811-47f0-8062-1bfca91afa5e req-e6c5a642-1c67-4db9-ab6a-bdeabe717cbe service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-00539926-c811-47f0-8062-1bfca91afa5e req-e6c5a642-1c67-4db9-ab6a-bdeabe717cbe service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-00539926-c811-47f0-8062-1bfca91afa5e req-e6c5a642-1c67-4db9-ab6a-bdeabe717cbe service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-00539926-c811-47f0-8062-1bfca91afa5e req-e6c5a642-1c67-4db9-ab6a-bdeabe717cbe service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-unplugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-00539926-c811-47f0-8062-1bfca91afa5e req-e6c5a642-1c67-4db9-ab6a-bdeabe717cbe service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-d4c11259-1723-4089-bafa-5491b75ae199 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-fa3ec626-50a5-49f0-ae4c-6a7561b9dfc4 req-ed435500-74e5-4114-828c-a7d8142b664d service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fa3ec626-50a5-49f0-ae4c-6a7561b9dfc4 req-ed435500-74e5-4114-828c-a7d8142b664d service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fa3ec626-50a5-49f0-ae4c-6a7561b9dfc4 req-ed435500-74e5-4114-828c-a7d8142b664d service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fa3ec626-50a5-49f0-ae4c-6a7561b9dfc4 req-ed435500-74e5-4114-828c-a7d8142b664d service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-fa3ec626-50a5-49f0-ae4c-6a7561b9dfc4 req-ed435500-74e5-4114-828c-a7d8142b664d service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-unplugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-fa3ec626-50a5-49f0-ae4c-6a7561b9dfc4 req-ed435500-74e5-4114-828c-a7d8142b664d service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e5355adf-00c2-494c-b3db-d6d1a4a1b5a4 req-cc9cdac9-4b27-44b7-8b0b-6e6ccf0c0640 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e5355adf-00c2-494c-b3db-d6d1a4a1b5a4 req-cc9cdac9-4b27-44b7-8b0b-6e6ccf0c0640 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e5355adf-00c2-494c-b3db-d6d1a4a1b5a4 req-cc9cdac9-4b27-44b7-8b0b-6e6ccf0c0640 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e5355adf-00c2-494c-b3db-d6d1a4a1b5a4 req-cc9cdac9-4b27-44b7-8b0b-6e6ccf0c0640 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e5355adf-00c2-494c-b3db-d6d1a4a1b5a4 req-cc9cdac9-4b27-44b7-8b0b-6e6ccf0c0640 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-unplugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e5355adf-00c2-494c-b3db-d6d1a4a1b5a4 req-cc9cdac9-4b27-44b7-8b0b-6e6ccf0c0640 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-173de29e-7f05-4c48-a99e-65c17978f884 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CMuwldXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '93856c37-436e-4121-bff2-c8135d84d1e3'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f589155d-6650-477d-b84f-2e9edfc56404]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:53 user nova-compute[75071]: No targets found.
Nov 29 13:20:53 user nova-compute[75071]: iSNS:
Nov 29 13:20:53 user nova-compute[75071]: No targets found.
Nov 29 13:20:53 user nova-compute[75071]: STATIC:
Nov 29 13:20:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43
Nov 29 13:20:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3
Nov 29 13:20:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2
Nov 29 13:20:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5
Nov 29 13:20:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:53 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:53 user nova-compute[75071]: No targets found.
Nov 29 13:20:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:53 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:53 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6089ab0b-d6d2-4c2a-933d-f6bbf77154da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57934db-e260-4bec-9659-6adce2a9dd2f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 (non-flash)
Nov 29 13:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f21484c1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3'): ({'sdi'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Removing single pathed devices sdi {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16c2741-387e-41f6-9326-5e8111519d27]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc227df-1cec-4730-ae39-e21509ce23ea]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Flushing IO for device /dev/sdi {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8495f26-9916-4f0c-9745-97c4f3e72c89]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d144dc-ee1d-43e0-a9d6-12013326b6ea]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] SCSI volumes sdi have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e117bc-ca64-416a-864f-3eb523deeacd]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52566a2-e9b0-49c8-9653-4e431ff8ce69]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260]
Nov 29 13:20:54 user nova-compute[75071]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93856c37-436e-4121-bff2-c8135d84d1e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e882cd-993f-4196-88b9-8b167737777c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] <== disconnect_volume: return (350ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5664a867-ffa0-4aae-9794-ee14a7d91e5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b002d748-69aa-4424-a1b6-0ff69a6c797e', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] swap_volume: removing Cinder connection for volume 93856c37-436e-4121-bff2-c8135d84d1e3 {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Instance destroyed successfully.
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lazy-loading 'resources' on Instance uuid 18f92aca-b5d2-4297-a767-e80a5dd92e42 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:27:23,bridge_name='br-int',has_traffic_filtering=True,id=bebccb20-85a0-41c5-a67f-7bbc1ab30f97,network=Network(cb634a0d-e68e-411c-9245-d412ba6b769d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebccb20-85') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:27:23,bridge_name='br-int',has_traffic_filtering=True,id=bebccb20-85a0-41c5-a67f-7bbc1ab30f97,network=Network(cb634a0d-e68e-411c-9245-d412ba6b769d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebccb20-85') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbebccb20-85, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa1131f4-a153-4467-9ed9-5786e8630603) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: INFO os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:27:23,bridge_name='br-int',has_traffic_filtering=True,id=bebccb20-85a0-41c5-a67f-7bbc1ab30f97,network=Network(cb634a0d-e68e-411c-9245-d412ba6b769d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebccb20-85')
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:90:91,bridge_name='br-int',has_traffic_filtering=True,id=d4c11259-1723-4089-bafa-5491b75ae199,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c11259-17') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:90:91,bridge_name='br-int',has_traffic_filtering=True,id=d4c11259-1723-4089-bafa-5491b75ae199,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c11259-17') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4c11259-17, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=829697cd-9461-4c9a-ba04-aaf5a43c3fcb) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: INFO os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:90:91,bridge_name='br-int',has_traffic_filtering=True,id=d4c11259-1723-4089-bafa-5491b75ae199,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4c11259-17')
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=408b448c-f2e4-4146-942b-060a45c75697,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap408b448c-f2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=408b448c-f2e4-4146-942b-060a45c75697,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap408b448c-f2') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap408b448c-f2, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d149b79-4efd-464c-9749-71073ec2c816) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: INFO os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=408b448c-f2e4-4146-942b-060a45c75697,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap408b448c-f2')
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "173de29e-7f05-4c48-a99e-65c17978f884", "address": "fa:16:3e:87:db:7d", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173de29e-7f", "ovs_interfaceid": "173de29e-7f05-4c48-a99e-65c17978f884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=173de29e-7f05-4c48-a99e-65c17978f884,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap173de29e-7f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=173de29e-7f05-4c48-a99e-65c17978f884,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap173de29e-7f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap173de29e-7f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=084f5bfb-042a-483d-9af2-5620dd0294ab) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: INFO os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:db:7d,bridge_name='br-int',has_traffic_filtering=True,id=173de29e-7f05-4c48-a99e-65c17978f884,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap173de29e-7f')
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=f124cc96-77e3-4b2b-b319-329a2bc02877,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124cc96-77') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=f124cc96-77e3-4b2b-b319-329a2bc02877,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124cc96-77') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf124cc96-77, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] swap_volume: Updating volume 93856c37-436e-4121-bff2-c8135d84d1e3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "AocnrNSw", "auth_password": "joOetANlQJF2Pd", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "b002d748-69aa-4424-a1b6-0ff69a6c797e"}, "status": "reserved", "instance": "5664a867-ffa0-4aae-9794-ee14a7d91e5e", "attached_at": "", "detached_at": "", "volume_id": "b002d748-69aa-4424-a1b6-0ff69a6c797e", "serial": "b002d748-69aa-4424-a1b6-0ff69a6c797e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b002d748-69aa-4424-a1b6-0ff69a6c797e', 'no_device': None, 'attachment_id': 'e1df3079-f209-44a4-9f8f-f834b3c6bd25'} {{(pid=75071) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9389d921-b87a-46d6-9d34-64747d3d1d77 tempest-TestVolumeSwap-1651786068 tempest-TestVolumeSwap-1651786068-project-admin] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.177s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=daaacd7f-6288-40ec-aa95-30bac3f2570b) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: INFO os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2f:37,bridge_name='br-int',has_traffic_filtering=True,id=f124cc96-77e3-4b2b-b319-329a2bc02877,network=Network(27380cc0-e10a-43e7-911a-c76165a8565d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf124cc96-77')
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:9f,bridge_name='br-int',has_traffic_filtering=True,id=52d3cf82-eb79-4cff-8340-6f6261ae86d2,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d3cf82-eb') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:9f,bridge_name='br-int',has_traffic_filtering=True,id=52d3cf82-eb79-4cff-8340-6f6261ae86d2,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d3cf82-eb') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52d3cf82-eb, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3da2ce95-f5e1-4add-ae1c-4a6bf8efbea8) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: INFO os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:c4:9f,bridge_name='br-int',has_traffic_filtering=True,id=52d3cf82-eb79-4cff-8340-6f6261ae86d2,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52d3cf82-eb')
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182336340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182336340',id=9,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIn8fFUzwCTX7QxEb+GNxkoA8YsJJ0gPwyDpErmmoP0zgMG2t2WhBKHgT2LxwItjilpmUrYiyGe1U9RVBsms1OuB9JygR5+jxHvmtW8DCQHf1Cc9w9xLpL0QkAPVsxbgog==',key_name='tempest-keypair-168835439',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f167b8b34d843b7825306c314d9dbea',ramdisk_id='',reservation_id='r-3vbh1qtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1179462252',owner_user_name='tempest-TaggedBootDevicesTest-1179462252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6ca17d2c1724d629da1a03d0b364aa0',uuid=18f92aca-b5d2-4297-a767-e80a5dd92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converting VIF {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:03:71,bridge_name='br-int',has_traffic_filtering=True,id=beb6c726-c067-4e1e-ae0c-33897dd13661,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb6c726-c0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:03:71,bridge_name='br-int',has_traffic_filtering=True,id=beb6c726-c067-4e1e-ae0c-33897dd13661,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb6c726-c0') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbeb6c726-c0, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21008798-68ee-4f8a-8d05-3e6715cbf626) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:55 user nova-compute[75071]: INFO os_vif [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:03:71,bridge_name='br-int',has_traffic_filtering=True,id=beb6c726-c067-4e1e-ae0c-33897dd13661,network=Network(0c0cbf47-bafe-447b-9abf-1bc1b88d190f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb6c726-c0')
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KYkPsTem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed75554-99c4-476d-ac1a-1b63e7ee359a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:55 user nova-compute[75071]: No targets found.
Nov 29 13:20:55 user nova-compute[75071]: iSNS:
Nov 29 13:20:55 user nova-compute[75071]: No targets found.
Nov 29 13:20:55 user nova-compute[75071]: STATIC:
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:55 user nova-compute[75071]: No targets found.
Nov 29 13:20:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:55 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:55 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd39ac0d-e555-4705-bc62-7ceb6b7cb99d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 for instance with vm_state active and task_state deleting.
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-unplugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-408b448c-f2e4-4146-942b-060a45c75697 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-408b448c-f2e4-4146-942b-060a45c75697 for instance with vm_state active and task_state deleting.
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-unplugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING nova.compute.manager [req-44516545-dfa4-4aba-b544-20766c7008ea req-478f21ad-ff75-41ae-be60-4b453030ead8 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-52d3cf82-eb79-4cff-8340-6f6261ae86d2 for instance with vm_state active and task_state deleting.
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-d4c11259-1723-4089-bafa-5491b75ae199 for instance with vm_state active and task_state deleting.
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-unplugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-beb6c726-c067-4e1e-ae0c-33897dd13661 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING nova.compute.manager [req-b7fc7d2c-f79f-4e95-86fd-71a85ba82b64 req-165ba688-22e4-4038-a616-9206eae6917b service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-beb6c726-c067-4e1e-ae0c-33897dd13661 for instance with vm_state active and task_state deleting.
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29af93c-b6f2-4562-8baf-3f8523a77c3a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fcbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[61093264-6e9d-4637-839b-0be60832b985]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5849544d-3d58-4baf-993d-190c239b7690]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f3aad-8b75-4814-8c27-211e30efa36f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0855e1e-e193-44f7-afc7-f4cb780e97ca]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e631f2-337f-4668-84a0-da5ad34f15e7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-173de29e-7f05-4c48-a99e-65c17978f884 for instance with vm_state active and task_state deleting.
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-unplugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-unplugged-f124cc96-77e3-4b2b-b319-329a2bc02877 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Acquiring lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] No waiting events found dispatching network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING nova.compute.manager [req-c13a6d95-c536-4644-a502-6e137ad3c2b0 req-4514c9c2-a93c-4ea0-bab5-05662ebd125f service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received unexpected event network-vif-plugged-f124cc96-77e3-4b2b-b319-329a2bc02877 for instance with vm_state active and task_state deleting.
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa6e379-d75b-4363-b308-604a3840d6d9]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260]
Nov 29 13:20:55 user nova-compute[75071]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cee32b5-89d0-44e2-9b50-78f31cb3ac43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07646c-abbc-4d0f-9bb2-0cb156e95ef0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== disconnect_volume: return (338ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYWDTKkB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[430bf98b-5248-4b13-8237-6a64e778c62d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:55 user nova-compute[75071]: No targets found.
Nov 29 13:20:55 user nova-compute[75071]: iSNS:
Nov 29 13:20:55 user nova-compute[75071]: No targets found.
Nov 29 13:20:55 user nova-compute[75071]: STATIC:
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:55 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:55 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:55 user nova-compute[75071]: No targets found.
Nov 29 13:20:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:55 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:55 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e1c61-bea9-4040-9ef7-677aae55b361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefee8f1-b3b2-4580-86b5-d1367fa1e0fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148350dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fb7137-ffc2-4cb9-8e8a-bfeeed9a3a6d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8638a0b8-b242-4c6c-ace6-0098a0fd19c5]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96c7b2c-cfab-4315-9d49-c5d7fd59f90b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f97b4-69b0-4187-a706-a9c7d1018e60]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d450642e-adb9-4534-8f78-dbc06cff3a43]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab0e4de-da9e-47e5-ab3f-a0d2347ea6c2]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260]
Nov 29 13:20:56 user nova-compute[75071]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d09130-7671-4e6d-bb03-4fcec62c07f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2df8b30-c70a-43ec-8e29-d62c41c2f02f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== disconnect_volume: return (312ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBGvzPyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:56 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b290760f-5a41-4488-aa35-32ee8aaeb613]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:56 user nova-compute[75071]: No targets found.
Nov 29 13:20:56 user nova-compute[75071]: iSNS:
Nov 29 13:20:56 user nova-compute[75071]: No targets found.
Nov 29 13:20:56 user nova-compute[75071]: STATIC:
Nov 29 13:20:56 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:56 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:56 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:56 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:56 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:56 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:56 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5
Nov 29 13:20:56 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:56 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:56 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:56 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:56 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:56 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:56 user nova-compute[75071]: No targets found.
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:56 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:56 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6584ea-ac94-414b-9b13-225c1aa727bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1174666e-b162-4953-95f2-244c87d69351]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148350dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f38d1-b7d2-41d3-9012-78c799fa6ede]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7833f335-eb20-4013-8e5a-66587af07a97]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb4ea61-d95a-41d9-9b2c-2461f6fed191]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b3791790-3607-48cc-a6f3-d7eceedc6c88 is timed out.
Nov 29 13:20:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Successfully detached device vdb from instance b3791790-3607-48cc-a6f3-d7eceedc6c88 from the live domain config.
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBcxkRJP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:20:56 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.064s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef84c02-3f03-459a-afa4-1ed48e0321b3]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa33cfbf-8bfa-42ff-b97b-3e01767be6b6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd59c25b-b2d5-48e2-89f7-ec34963c38f3]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260]
Nov 29 13:20:56 user nova-compute[75071]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba36a45-7c5b-46c7-aba8-39acf108c2a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[772bb6ce-494f-4753-901e-87cb5255b86f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] <== disconnect_volume: return (335ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Deleting instance files /opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42_del
Nov 29 13:20:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Deletion of /opt/stack/data/nova/instances/18f92aca-b5d2-4297-a767-e80a5dd92e42_del complete
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.178s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3690f4-2ce1-4f81-8408-e31266029c68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:20:56 user nova-compute[75071]: No targets found.
Nov 29 13:20:56 user nova-compute[75071]: iSNS:
Nov 29 13:20:56 user nova-compute[75071]: No targets found.
Nov 29 13:20:56 user nova-compute[75071]: STATIC:
Nov 29 13:20:56 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:56 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:56 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:56 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:20:56 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:56 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:56 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e
Nov 29 13:20:56 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:20:56 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:20:56 user nova-compute[75071]: FIRMWARE:
Nov 29 13:20:56 user nova-compute[75071]: No targets found.
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:20:56 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:20:56 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[607ecdc7-c632-48eb-94e4-1479413ea6de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: INFO nova.compute.manager [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Took 3.55 seconds to destroy the instance on the hypervisor.
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad99609-8a1b-4e93-ba23-8eb354f8652a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:20:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fc9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e'): ({'sdj'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Removing single pathed devices sdj {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57d54c2-fecb-41a4-b06b-40673af3e752]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e2b1f4-4b9d-46e3-890d-9961b0f9d8d4]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Flushing IO for device /dev/sdj {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b2d07-4411-4c6b-8057-a06085b3592d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca3250-4242-4732-a4cb-acd658025b7e]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] SCSI volumes sdj have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[06691f1c-d6a0-47eb-9ae3-6f7e391c0f17]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33397a21-5e63-4f6f-a8d1-a95298d5a441]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260]
Nov 29 13:20:56 user nova-compute[75071]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e, portal: 172.16.0.220,3260] successful.
Nov 29 13:20:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4755ace-37fe-421c-ab7d-a8ab2dbf6d8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884e4b4-33dd-4b75-b8d4-dd4a4821bc61]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] <== disconnect_volume: return (497ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:20:56 user nova-compute[75071]: INFO nova.compute.manager [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Detaching volume b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:20:56 user nova-compute[75071]: INFO nova.virt.block_device [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Attempting to driver detach volume b002d748-69aa-4424-a1b6-0ff69a6c797e from mountpoint /dev/vdb
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Attempting to detach device vdb from instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:20:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:56 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:56 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:20:56 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:56 user nova-compute[75071]:   <serial>b002d748-69aa-4424-a1b6-0ff69a6c797e</serial>
Nov 29 13:20:56 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:20:56 user nova-compute[75071]: </disk>
Nov 29 13:20:56 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Successfully detached device vdb from instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e from the persistent domain config.
Nov 29 13:20:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:20:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:20:57 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:20:57 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:20:57 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:20:57 user nova-compute[75071]:   <serial>b002d748-69aa-4424-a1b6-0ff69a6c797e</serial>
Nov 29 13:20:57 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:20:57 user nova-compute[75071]: </disk>
Nov 29 13:20:57 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:20:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:20:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lazy-loading 'flavor' on Instance uuid b3791790-3607-48cc-a6f3-d7eceedc6c88 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f60669e2-16e8-473f-976a-3e5395e6a622 tempest-VolumesAssistedSnapshotsTest-1550389033 tempest-VolumesAssistedSnapshotsTest-1550389033-project-admin] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.309s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:20:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-15724b89-2911-44b7-9941-46207be0c8ee req-46643f02-a4b2-4465-84e5-46ddcdc8bad6 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-deleted-173de29e-7f05-4c48-a99e-65c17978f884 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:20:58 user nova-compute[75071]: INFO nova.compute.manager [req-15724b89-2911-44b7-9941-46207be0c8ee req-46643f02-a4b2-4465-84e5-46ddcdc8bad6 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Neutron deleted interface 173de29e-7f05-4c48-a99e-65c17978f884; detaching it from the instance and deleting it from the info cache
Nov 29 13:20:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-15724b89-2911-44b7-9941-46207be0c8ee req-46643f02-a4b2-4465-84e5-46ddcdc8bad6 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [{"id": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "address": "fa:16:3e:e5:27:23", "network": {"id": "cb634a0d-e68e-411c-9245-d412ba6b769d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1213447310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebccb20-85", "ovs_interfaceid": "bebccb20-85a0-41c5-a67f-7bbc1ab30f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4c11259-1723-4089-bafa-5491b75ae199", "address": "fa:16:3e:24:90:91", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4c11259-17", "ovs_interfaceid": "d4c11259-1723-4089-bafa-5491b75ae199", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "408b448c-f2e4-4146-942b-060a45c75697", "address": "fa:16:3e:49:a3:2a", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap408b448c-f2", "ovs_interfaceid": "408b448c-f2e4-4146-942b-060a45c75697", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f124cc96-77e3-4b2b-b319-329a2bc02877", "address": "fa:16:3e:9c:2f:37", "network": {"id": "27380cc0-e10a-43e7-911a-c76165a8565d", "bridge": "br-int", "label": "tempest-device-tagging-net1-925587258", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf124cc96-77", "ovs_interfaceid": "f124cc96-77e3-4b2b-b319-329a2bc02877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "address": "fa:16:3e:a5:c4:9f", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52d3cf82-eb", "ovs_interfaceid": "52d3cf82-eb79-4cff-8340-6f6261ae86d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "beb6c726-c067-4e1e-ae0c-33897dd13661", "address": "fa:16:3e:35:03:71", "network": {"id": "0c0cbf47-bafe-447b-9abf-1bc1b88d190f", "bridge": "br-int", "label": "tempest-device-tagging-net2-584022741", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4f167b8b34d843b7825306c314d9dbea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb6c726-c0", "ovs_interfaceid": "beb6c726-c067-4e1e-ae0c-33897dd13661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-15724b89-2911-44b7-9941-46207be0c8ee req-46643f02-a4b2-4465-84e5-46ddcdc8bad6 service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Detach interface failed, port_id=173de29e-7f05-4c48-a99e-65c17978f884, reason: Instance 18f92aca-b5d2-4297-a767-e80a5dd92e42 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:21:00 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:00 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Took 3.53 seconds to deallocate network for instance.
Nov 29 13:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-caf7b436-b43b-419d-9ffe-89a5094a50b5 req-6beb4136-2bf1-4b6d-baaa-8098b2f2e64a service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-deleted-f124cc96-77e3-4b2b-b319-329a2bc02877 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-caf7b436-b43b-419d-9ffe-89a5094a50b5 req-6beb4136-2bf1-4b6d-baaa-8098b2f2e64a service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-deleted-beb6c726-c067-4e1e-ae0c-33897dd13661 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-caf7b436-b43b-419d-9ffe-89a5094a50b5 req-6beb4136-2bf1-4b6d-baaa-8098b2f2e64a service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-deleted-bebccb20-85a0-41c5-a67f-7bbc1ab30f97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-caf7b436-b43b-419d-9ffe-89a5094a50b5 req-6beb4136-2bf1-4b6d-baaa-8098b2f2e64a service nova] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Received event network-vif-deleted-52d3cf82-eb79-4cff-8340-6f6261ae86d2 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:02 user nova-compute[75071]: INFO nova.compute.manager [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] [instance: 18f92aca-b5d2-4297-a767-e80a5dd92e42] Took 2.26 seconds to detach 3 volumes for instance.
Nov 29 13:21:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:02 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:02 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:02 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Deleted allocations for instance 18f92aca-b5d2-4297-a767-e80a5dd92e42
Nov 29 13:21:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-61920ee1-407e-426b-915b-5a06a9d0913a tempest-TaggedBootDevicesTest-1179462252 tempest-TaggedBootDevicesTest-1179462252-project-member] Lock "18f92aca-b5d2-4297-a767-e80a5dd92e42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.876s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:21:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:07 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:21:07 user nova-compute[75071]: INFO nova.compute.claims [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Claim successful on node user
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:21:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.policy [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44500d2105a742ddacaf6e766f042bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c2c9d59234462091e0e4548c770d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:21:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Creating image(s)
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "/opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "/opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Waiting for libvirt event about the detach of device tap7c0b9f9f-d2 with device alias net1 from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b is timed out.
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 13:21:08 user nova-compute[75071]:   <name>instance-00000006</name>
Nov 29 13:21:08 user nova-compute[75071]:   <uuid>2a30460f-0839-4256-a3b8-0c6e170fbe4b</uuid>
Nov 29 13:21:08 user nova-compute[75071]:   <metadata>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:21:08 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:creationTime>2023-11-29 13:20:07</nova:creationTime>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Nov 29 13:21:08 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Nov 29 13:21:08 user nova-compute[75071]:   </nova:flavor>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:owner>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:21:08 user nova-compute[75071]:   </nova:owner>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:ports>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:21:08 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:21:08 user nova-compute[75071]:     </nova:port>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:port uuid="7c0b9f9f-d2f5-461e-af21-746f1e08a64b">
Nov 29 13:21:08 user nova-compute[75071]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 29 13:21:08 user nova-compute[75071]:     </nova:port>
Nov 29 13:21:08 user nova-compute[75071]:   </nova:ports>
Nov 29 13:21:08 user nova-compute[75071]: </nova:instance>
Nov 29 13:21:08 user nova-compute[75071]:   </metadata>
Nov 29 13:21:08 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Nov 29 13:21:08 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 13:21:08 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Nov 29 13:21:08 user nova-compute[75071]:   <resource>
Nov 29 13:21:08 user nova-compute[75071]:     <partition>/machine</partition>
Nov 29 13:21:08 user nova-compute[75071]:   </resource>
Nov 29 13:21:08 user nova-compute[75071]:   <sysinfo type='smbios'>
Nov 29 13:21:08 user nova-compute[75071]:     <system>
Nov 29 13:21:08 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 13:21:08 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 13:21:08 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Nov 29 13:21:08 user nova-compute[75071]:       <entry name='serial'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:21:08 user nova-compute[75071]:       <entry name='uuid'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:21:08 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Nov 29 13:21:08 user nova-compute[75071]:     </system>
Nov 29 13:21:08 user nova-compute[75071]:   </sysinfo>
Nov 29 13:21:08 user nova-compute[75071]:   <os>
Nov 29 13:21:08 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 13:21:08 user nova-compute[75071]:     <boot dev='hd'/>
Nov 29 13:21:08 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Nov 29 13:21:08 user nova-compute[75071]:   </os>
Nov 29 13:21:08 user nova-compute[75071]:   <features>
Nov 29 13:21:08 user nova-compute[75071]:     <acpi/>
Nov 29 13:21:08 user nova-compute[75071]:     <apic/>
Nov 29 13:21:08 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Nov 29 13:21:08 user nova-compute[75071]:   </features>
Nov 29 13:21:08 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 13:21:08 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Nov 29 13:21:08 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 13:21:08 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Nov 29 13:21:08 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Nov 29 13:21:08 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Nov 29 13:21:08 user nova-compute[75071]:   </cpu>
Nov 29 13:21:08 user nova-compute[75071]:   <clock offset='utc'>
Nov 29 13:21:08 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 13:21:08 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 13:21:08 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Nov 29 13:21:08 user nova-compute[75071]:   </clock>
Nov 29 13:21:08 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Nov 29 13:21:08 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Nov 29 13:21:08 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Nov 29 13:21:08 user nova-compute[75071]:   <devices>
Nov 29 13:21:08 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 13:21:08 user nova-compute[75071]:     <disk type='file' device='disk'>
Nov 29 13:21:08 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 13:21:08 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk' index='2'/>
Nov 29 13:21:08 user nova-compute[75071]:       <backingStore type='file' index='3'>
Nov 29 13:21:08 user nova-compute[75071]:         <format type='raw'/>
Nov 29 13:21:08 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3'/>
Nov 29 13:21:08 user nova-compute[75071]:         <backingStore/>
Nov 29 13:21:08 user nova-compute[75071]:       </backingStore>
Nov 29 13:21:08 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Nov 29 13:21:08 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </disk>
Nov 29 13:21:08 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Nov 29 13:21:08 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 13:21:08 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config' index='1'/>
Nov 29 13:21:08 user nova-compute[75071]:       <backingStore/>
Nov 29 13:21:08 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Nov 29 13:21:08 user nova-compute[75071]:       <readonly/>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Nov 29 13:21:08 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </disk>
Nov 29 13:21:08 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='usb'/>
Nov 29 13:21:08 user nova-compute[75071]:     </controller>
Nov 29 13:21:08 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='pci.0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </controller>
Nov 29 13:21:08 user nova-compute[75071]:     <controller type='ide' index='0'>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='ide'/>
Nov 29 13:21:08 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 13:21:08 user nova-compute[75071]:     </controller>
Nov 29 13:21:08 user nova-compute[75071]:     <interface type='ethernet'>
Nov 29 13:21:08 user nova-compute[75071]:       <mac address='fa:16:3e:8f:c5:4a'/>
Nov 29 13:21:08 user nova-compute[75071]:       <target dev='tap254915cd-7b'/>
Nov 29 13:21:08 user nova-compute[75071]:       <model type='virtio'/>
Nov 29 13:21:08 user nova-compute[75071]:       <mtu size='1442'/>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='net0'/>
Nov 29 13:21:08 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </interface>
Nov 29 13:21:08 user nova-compute[75071]:     <serial type='pty'>
Nov 29 13:21:08 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:21:08 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:21:08 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Nov 29 13:21:08 user nova-compute[75071]:         <model name='isa-serial'/>
Nov 29 13:21:08 user nova-compute[75071]:       </target>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </serial>
Nov 29 13:21:08 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 13:21:08 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:21:08 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:21:08 user nova-compute[75071]:       <target type='serial' port='0'/>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </console>
Nov 29 13:21:08 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='input0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </input>
Nov 29 13:21:08 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='input1'/>
Nov 29 13:21:08 user nova-compute[75071]:     </input>
Nov 29 13:21:08 user nova-compute[75071]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 13:21:08 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </graphics>
Nov 29 13:21:08 user nova-compute[75071]:     <audio id='1' type='none'/>
Nov 29 13:21:08 user nova-compute[75071]:     <video>
Nov 29 13:21:08 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='video0'/>
Nov 29 13:21:08 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </video>
Nov 29 13:21:08 user nova-compute[75071]:     <memballoon model='virtio'>
Nov 29 13:21:08 user nova-compute[75071]:       <stats period='10'/>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='balloon0'/>
Nov 29 13:21:08 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </memballoon>
Nov 29 13:21:08 user nova-compute[75071]:     <rng model='virtio'>
Nov 29 13:21:08 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Nov 29 13:21:08 user nova-compute[75071]:       <alias name='rng0'/>
Nov 29 13:21:08 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 13:21:08 user nova-compute[75071]:     </rng>
Nov 29 13:21:08 user nova-compute[75071]:   </devices>
Nov 29 13:21:08 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 13:21:08 user nova-compute[75071]:     <label>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</label>
Nov 29 13:21:08 user nova-compute[75071]:     <imagelabel>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</imagelabel>
Nov 29 13:21:08 user nova-compute[75071]:   </seclabel>
Nov 29 13:21:08 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 13:21:08 user nova-compute[75071]:     <label>+64055:+108</label>
Nov 29 13:21:08 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 13:21:08 user nova-compute[75071]:   </seclabel>
Nov 29 13:21:08 user nova-compute[75071]: </domain>
Nov 29 13:21:08 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 13:21:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully detached device tap7c0b9f9f-d2 from instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b from the live domain config.
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converting VIF {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG os_vif [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c0b9f9f-d2, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3fc8985a-eb51-4ed0-98ca-f3e03b5bec2d) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:08 user nova-compute[75071]: INFO os_vif [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2')
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:21:08 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:creationTime>2023-11-29 13:21:08</nova:creationTime>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Nov 29 13:21:08 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Nov 29 13:21:08 user nova-compute[75071]:   </nova:flavor>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:owner>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:21:08 user nova-compute[75071]:   </nova:owner>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:21:08 user nova-compute[75071]:   <nova:ports>
Nov 29 13:21:08 user nova-compute[75071]:     <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:21:08 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:21:08 user nova-compute[75071]:     </nova:port>
Nov 29 13:21:08 user nova-compute[75071]:   </nova:ports>
Nov 29 13:21:08 user nova-compute[75071]: </nova:instance>
Nov 29 13:21:08 user nova-compute[75071]:  {{(pid=75071) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Successfully created port: 82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk 1073741824" returned: 0 in 0.050s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-deleted-7c0b9f9f-d2f5-461e-af21-746f1e08a64b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:09 user nova-compute[75071]: INFO nova.compute.manager [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Neutron deleted interface 7c0b9f9f-d2f5-461e-af21-746f1e08a64b; detaching it from the instance and deleting it from the info cache
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.objects.instance [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Lazy-loading 'system_metadata' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquired lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.objects.instance [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Lazy-loading 'flavor' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.objects.base [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Object Instance<2a30460f-0839-4256-a3b8-0c6e170fbe4b> lazy-loaded attributes: system_metadata,flavor {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Converting VIF {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Cannot resize image /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Ensure instance console log exists: /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 13:21:09 user nova-compute[75071]:   <name>instance-00000006</name>
Nov 29 13:21:09 user nova-compute[75071]:   <uuid>2a30460f-0839-4256-a3b8-0c6e170fbe4b</uuid>
Nov 29 13:21:09 user nova-compute[75071]:   <metadata>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:21:09 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:creationTime>2023-11-29 13:21:08</nova:creationTime>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Nov 29 13:21:09 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:flavor>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:ports>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:21:09 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:21:09 user nova-compute[75071]:     </nova:port>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:ports>
Nov 29 13:21:09 user nova-compute[75071]: </nova:instance>
Nov 29 13:21:09 user nova-compute[75071]:   </metadata>
Nov 29 13:21:09 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Nov 29 13:21:09 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 13:21:09 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Nov 29 13:21:09 user nova-compute[75071]:   <resource>
Nov 29 13:21:09 user nova-compute[75071]:     <partition>/machine</partition>
Nov 29 13:21:09 user nova-compute[75071]:   </resource>
Nov 29 13:21:09 user nova-compute[75071]:   <sysinfo type='smbios'>
Nov 29 13:21:09 user nova-compute[75071]:     <system>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='serial'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='uuid'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Nov 29 13:21:09 user nova-compute[75071]:     </system>
Nov 29 13:21:09 user nova-compute[75071]:   </sysinfo>
Nov 29 13:21:09 user nova-compute[75071]:   <os>
Nov 29 13:21:09 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 13:21:09 user nova-compute[75071]:     <boot dev='hd'/>
Nov 29 13:21:09 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Nov 29 13:21:09 user nova-compute[75071]:   </os>
Nov 29 13:21:09 user nova-compute[75071]:   <features>
Nov 29 13:21:09 user nova-compute[75071]:     <acpi/>
Nov 29 13:21:09 user nova-compute[75071]:     <apic/>
Nov 29 13:21:09 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Nov 29 13:21:09 user nova-compute[75071]:   </features>
Nov 29 13:21:09 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 13:21:09 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Nov 29 13:21:09 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 13:21:09 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Nov 29 13:21:09 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Nov 29 13:21:09 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Nov 29 13:21:09 user nova-compute[75071]:   </cpu>
Nov 29 13:21:09 user nova-compute[75071]:   <clock offset='utc'>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Nov 29 13:21:09 user nova-compute[75071]:   </clock>
Nov 29 13:21:09 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Nov 29 13:21:09 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Nov 29 13:21:09 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Nov 29 13:21:09 user nova-compute[75071]:   <devices>
Nov 29 13:21:09 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 13:21:09 user nova-compute[75071]:     <disk type='file' device='disk'>
Nov 29 13:21:09 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 13:21:09 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk' index='2'/>
Nov 29 13:21:09 user nova-compute[75071]:       <backingStore type='file' index='3'>
Nov 29 13:21:09 user nova-compute[75071]:         <format type='raw'/>
Nov 29 13:21:09 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3'/>
Nov 29 13:21:09 user nova-compute[75071]:         <backingStore/>
Nov 29 13:21:09 user nova-compute[75071]:       </backingStore>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </disk>
Nov 29 13:21:09 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Nov 29 13:21:09 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 13:21:09 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config' index='1'/>
Nov 29 13:21:09 user nova-compute[75071]:       <backingStore/>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Nov 29 13:21:09 user nova-compute[75071]:       <readonly/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </disk>
Nov 29 13:21:09 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='usb'/>
Nov 29 13:21:09 user nova-compute[75071]:     </controller>
Nov 29 13:21:09 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='pci.0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </controller>
Nov 29 13:21:09 user nova-compute[75071]:     <controller type='ide' index='0'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='ide'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 13:21:09 user nova-compute[75071]:     </controller>
Nov 29 13:21:09 user nova-compute[75071]:     <interface type='ethernet'>
Nov 29 13:21:09 user nova-compute[75071]:       <mac address='fa:16:3e:8f:c5:4a'/>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev='tap254915cd-7b'/>
Nov 29 13:21:09 user nova-compute[75071]:       <model type='virtio'/>
Nov 29 13:21:09 user nova-compute[75071]:       <mtu size='1442'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='net0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </interface>
Nov 29 13:21:09 user nova-compute[75071]:     <serial type='pty'>
Nov 29 13:21:09 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:21:09 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:21:09 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Nov 29 13:21:09 user nova-compute[75071]:         <model name='isa-serial'/>
Nov 29 13:21:09 user nova-compute[75071]:       </target>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </serial>
Nov 29 13:21:09 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 13:21:09 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:21:09 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:21:09 user nova-compute[75071]:       <target type='serial' port='0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </console>
Nov 29 13:21:09 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='input0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </input>
Nov 29 13:21:09 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='input1'/>
Nov 29 13:21:09 user nova-compute[75071]:     </input>
Nov 29 13:21:09 user nova-compute[75071]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 13:21:09 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </graphics>
Nov 29 13:21:09 user nova-compute[75071]:     <audio id='1' type='none'/>
Nov 29 13:21:09 user nova-compute[75071]:     <video>
Nov 29 13:21:09 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='video0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </video>
Nov 29 13:21:09 user nova-compute[75071]:     <memballoon model='virtio'>
Nov 29 13:21:09 user nova-compute[75071]:       <stats period='10'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='balloon0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </memballoon>
Nov 29 13:21:09 user nova-compute[75071]:     <rng model='virtio'>
Nov 29 13:21:09 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='rng0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </rng>
Nov 29 13:21:09 user nova-compute[75071]:   </devices>
Nov 29 13:21:09 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 13:21:09 user nova-compute[75071]:     <label>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</label>
Nov 29 13:21:09 user nova-compute[75071]:     <imagelabel>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</imagelabel>
Nov 29 13:21:09 user nova-compute[75071]:   </seclabel>
Nov 29 13:21:09 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 13:21:09 user nova-compute[75071]:     <label>+64055:+108</label>
Nov 29 13:21:09 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 13:21:09 user nova-compute[75071]:   </seclabel>
Nov 29 13:21:09 user nova-compute[75071]: </domain>
Nov 29 13:21:09 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:89:70:d3"/><model type="virtio"/><mtu size="1442"/><target dev="tap7c0b9f9f-d2"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 13:21:09 user nova-compute[75071]:   <name>instance-00000006</name>
Nov 29 13:21:09 user nova-compute[75071]:   <uuid>2a30460f-0839-4256-a3b8-0c6e170fbe4b</uuid>
Nov 29 13:21:09 user nova-compute[75071]:   <metadata>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:21:09 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:creationTime>2023-11-29 13:21:08</nova:creationTime>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Nov 29 13:21:09 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:flavor>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:ports>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:21:09 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:21:09 user nova-compute[75071]:     </nova:port>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:ports>
Nov 29 13:21:09 user nova-compute[75071]: </nova:instance>
Nov 29 13:21:09 user nova-compute[75071]:   </metadata>
Nov 29 13:21:09 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Nov 29 13:21:09 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 13:21:09 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Nov 29 13:21:09 user nova-compute[75071]:   <resource>
Nov 29 13:21:09 user nova-compute[75071]:     <partition>/machine</partition>
Nov 29 13:21:09 user nova-compute[75071]:   </resource>
Nov 29 13:21:09 user nova-compute[75071]:   <sysinfo type='smbios'>
Nov 29 13:21:09 user nova-compute[75071]:     <system>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='serial'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='uuid'>2a30460f-0839-4256-a3b8-0c6e170fbe4b</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Nov 29 13:21:09 user nova-compute[75071]:     </system>
Nov 29 13:21:09 user nova-compute[75071]:   </sysinfo>
Nov 29 13:21:09 user nova-compute[75071]:   <os>
Nov 29 13:21:09 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 13:21:09 user nova-compute[75071]:     <boot dev='hd'/>
Nov 29 13:21:09 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Nov 29 13:21:09 user nova-compute[75071]:   </os>
Nov 29 13:21:09 user nova-compute[75071]:   <features>
Nov 29 13:21:09 user nova-compute[75071]:     <acpi/>
Nov 29 13:21:09 user nova-compute[75071]:     <apic/>
Nov 29 13:21:09 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Nov 29 13:21:09 user nova-compute[75071]:   </features>
Nov 29 13:21:09 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 13:21:09 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Nov 29 13:21:09 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 13:21:09 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Nov 29 13:21:09 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Nov 29 13:21:09 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Nov 29 13:21:09 user nova-compute[75071]:   </cpu>
Nov 29 13:21:09 user nova-compute[75071]:   <clock offset='utc'>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Nov 29 13:21:09 user nova-compute[75071]:   </clock>
Nov 29 13:21:09 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Nov 29 13:21:09 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Nov 29 13:21:09 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Nov 29 13:21:09 user nova-compute[75071]:   <devices>
Nov 29 13:21:09 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 13:21:09 user nova-compute[75071]:     <disk type='file' device='disk'>
Nov 29 13:21:09 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 13:21:09 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk' index='2'/>
Nov 29 13:21:09 user nova-compute[75071]:       <backingStore type='file' index='3'>
Nov 29 13:21:09 user nova-compute[75071]:         <format type='raw'/>
Nov 29 13:21:09 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3'/>
Nov 29 13:21:09 user nova-compute[75071]:         <backingStore/>
Nov 29 13:21:09 user nova-compute[75071]:       </backingStore>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </disk>
Nov 29 13:21:09 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Nov 29 13:21:09 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 13:21:09 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/disk.config' index='1'/>
Nov 29 13:21:09 user nova-compute[75071]:       <backingStore/>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Nov 29 13:21:09 user nova-compute[75071]:       <readonly/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </disk>
Nov 29 13:21:09 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='usb'/>
Nov 29 13:21:09 user nova-compute[75071]:     </controller>
Nov 29 13:21:09 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='pci.0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </controller>
Nov 29 13:21:09 user nova-compute[75071]:     <controller type='ide' index='0'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='ide'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 13:21:09 user nova-compute[75071]:     </controller>
Nov 29 13:21:09 user nova-compute[75071]:     <interface type='ethernet'>
Nov 29 13:21:09 user nova-compute[75071]:       <mac address='fa:16:3e:8f:c5:4a'/>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev='tap254915cd-7b'/>
Nov 29 13:21:09 user nova-compute[75071]:       <model type='virtio'/>
Nov 29 13:21:09 user nova-compute[75071]:       <mtu size='1442'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='net0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </interface>
Nov 29 13:21:09 user nova-compute[75071]:     <serial type='pty'>
Nov 29 13:21:09 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:21:09 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:21:09 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Nov 29 13:21:09 user nova-compute[75071]:         <model name='isa-serial'/>
Nov 29 13:21:09 user nova-compute[75071]:       </target>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </serial>
Nov 29 13:21:09 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 13:21:09 user nova-compute[75071]:       <source path='/dev/pts/5'/>
Nov 29 13:21:09 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b/console.log' append='off'/>
Nov 29 13:21:09 user nova-compute[75071]:       <target type='serial' port='0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='serial0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </console>
Nov 29 13:21:09 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='input0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </input>
Nov 29 13:21:09 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='input1'/>
Nov 29 13:21:09 user nova-compute[75071]:     </input>
Nov 29 13:21:09 user nova-compute[75071]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 13:21:09 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </graphics>
Nov 29 13:21:09 user nova-compute[75071]:     <audio id='1' type='none'/>
Nov 29 13:21:09 user nova-compute[75071]:     <video>
Nov 29 13:21:09 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='video0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </video>
Nov 29 13:21:09 user nova-compute[75071]:     <memballoon model='virtio'>
Nov 29 13:21:09 user nova-compute[75071]:       <stats period='10'/>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='balloon0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </memballoon>
Nov 29 13:21:09 user nova-compute[75071]:     <rng model='virtio'>
Nov 29 13:21:09 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Nov 29 13:21:09 user nova-compute[75071]:       <alias name='rng0'/>
Nov 29 13:21:09 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 13:21:09 user nova-compute[75071]:     </rng>
Nov 29 13:21:09 user nova-compute[75071]:   </devices>
Nov 29 13:21:09 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 13:21:09 user nova-compute[75071]:     <label>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</label>
Nov 29 13:21:09 user nova-compute[75071]:     <imagelabel>libvirt-2a30460f-0839-4256-a3b8-0c6e170fbe4b</imagelabel>
Nov 29 13:21:09 user nova-compute[75071]:   </seclabel>
Nov 29 13:21:09 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 13:21:09 user nova-compute[75071]:     <label>+64055:+108</label>
Nov 29 13:21:09 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 13:21:09 user nova-compute[75071]:   </seclabel>
Nov 29 13:21:09 user nova-compute[75071]: </domain>
Nov 29 13:21:09 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 13:21:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Detaching interface fa:16:3e:89:70:d3 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap7c0b9f9f-d2' not found.
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Converting VIF {"id": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "address": "fa:16:3e:89:70:d3", "network": {"id": "43a1a88e-57f4-4416-8717-46ebb2cf649a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-775161067", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0b9f9f-d2", "ovs_interfaceid": "7c0b9f9f-d2f5-461e-af21-746f1e08a64b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG os_vif [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c0b9f9f-d2, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:21:09 user nova-compute[75071]: INFO os_vif [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:70:d3,bridge_name='br-int',has_traffic_filtering=True,id=7c0b9f9f-d2f5-461e-af21-746f1e08a64b,network=Network(43a1a88e-57f4-4416-8717-46ebb2cf649a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0b9f9f-d2')
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-09fa79df-fb8c-4627-acb5-5f78a3c98a9c req-fa90b481-d021-465f-b8c3-651ddfdfae53 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:21:09 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-40624585</nova:name>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:creationTime>2023-11-29 13:21:09</nova:creationTime>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Nov 29 13:21:09 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:flavor>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:user uuid="2620d9a6cc1b4f789bdb2cb0827fee65">tempest-TaggedAttachmentsTest-800730260-project-member</nova:user>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:project uuid="d794844d6bd7438dba426da0c83eea2e">tempest-TaggedAttachmentsTest-800730260</nova:project>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:21:09 user nova-compute[75071]:   <nova:ports>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:port uuid="254915cd-7b23-4208-a5bf-af1133dc3493">
Nov 29 13:21:09 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:21:09 user nova-compute[75071]:     </nova:port>
Nov 29 13:21:09 user nova-compute[75071]:   </nova:ports>
Nov 29 13:21:09 user nova-compute[75071]: </nova:instance>
Nov 29 13:21:09 user nova-compute[75071]:  {{(pid=75071) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Successfully updated port: 82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "refresh_cache-2ae7c6e1-1feb-413d-b11d-aa6ff502d292" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquired lock "refresh_cache-2ae7c6e1-1feb-413d-b11d-aa6ff502d292" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Received event network-changed-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Refreshing instance network info cache due to event network-changed-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] Acquiring lock "refresh_cache-2ae7c6e1-1feb-413d-b11d-aa6ff502d292" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [{"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Releasing lock "refresh_cache-2a30460f-0839-4256-a3b8-0c6e170fbe4b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-70465ba1-3347-4d05-84cc-231d1eeb02a8 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "interface-2a30460f-0839-4256-a3b8-0c6e170fbe4b-7c0b9f9f-d2f5-461e-af21-746f1e08a64b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.562s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Updating instance_info_cache with network_info: [{"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Releasing lock "refresh_cache-2ae7c6e1-1feb-413d-b11d-aa6ff502d292" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Instance network_info: |[{"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] Acquired lock "refresh_cache-2ae7c6e1-1feb-413d-b11d-aa6ff502d292" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Refreshing network info cache for port 82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Start _get_guest_xml network_info=[{"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:21:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:21:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1471014675',display_name='tempest-VolumesAdminNegativeTest-server-1471014675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1471014675',id=13,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c2c9d59234462091e0e4548c770d12',ramdisk_id='',reservation_id='r-d78gyzoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-984213226',owner_user_name='tempest-VolumesAdminNegativeTest-984213226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:21:09Z,user_data=None,user_id='44500d2105a742ddacaf6e766f042bf2',uuid=2ae7c6e1-1feb-413d-b11d-aa6ff502d292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converting VIF {"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:39,bridge_name='br-int',has_traffic_filtering=True,id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a84dc1-9f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ae7c6e1-1feb-413d-b11d-aa6ff502d292 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:21:09 user nova-compute[75071]:   <uuid>2ae7c6e1-1feb-413d-b11d-aa6ff502d292</uuid>
Nov 29 13:21:09 user nova-compute[75071]:   <name>instance-0000000d</name>
Nov 29 13:21:09 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:21:09 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:21:09 user nova-compute[75071]:   <metadata>
Nov 29 13:21:09 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:21:09 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:21:09 user nova-compute[75071]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1471014675</nova:name>
Nov 29 13:21:09 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:21:09</nova:creationTime>
Nov 29 13:21:09 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:21:09 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:21:09 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:21:09 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:21:09 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:21:09 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:21:09 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:21:09 user nova-compute[75071]:       <nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:         <nova:user uuid="44500d2105a742ddacaf6e766f042bf2">tempest-VolumesAdminNegativeTest-984213226-project-member</nova:user>
Nov 29 13:21:09 user nova-compute[75071]:         <nova:project uuid="f5c2c9d59234462091e0e4548c770d12">tempest-VolumesAdminNegativeTest-984213226</nova:project>
Nov 29 13:21:09 user nova-compute[75071]:       </nova:owner>
Nov 29 13:21:09 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:21:09 user nova-compute[75071]:       <nova:ports>
Nov 29 13:21:09 user nova-compute[75071]:         <nova:port uuid="82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9">
Nov 29 13:21:09 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 13:21:09 user nova-compute[75071]:         </nova:port>
Nov 29 13:21:09 user nova-compute[75071]:       </nova:ports>
Nov 29 13:21:09 user nova-compute[75071]:     </nova:instance>
Nov 29 13:21:09 user nova-compute[75071]:   </metadata>
Nov 29 13:21:09 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:21:09 user nova-compute[75071]:     <system>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name="serial">2ae7c6e1-1feb-413d-b11d-aa6ff502d292</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name="uuid">2ae7c6e1-1feb-413d-b11d-aa6ff502d292</entry>
Nov 29 13:21:09 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:21:09 user nova-compute[75071]:     </system>
Nov 29 13:21:09 user nova-compute[75071]:   </sysinfo>
Nov 29 13:21:09 user nova-compute[75071]:   <os>
Nov 29 13:21:09 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:21:09 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:21:09 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:21:09 user nova-compute[75071]:   </os>
Nov 29 13:21:09 user nova-compute[75071]:   <features>
Nov 29 13:21:09 user nova-compute[75071]:     <acpi/>
Nov 29 13:21:09 user nova-compute[75071]:     <apic/>
Nov 29 13:21:09 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:21:09 user nova-compute[75071]:   </features>
Nov 29 13:21:09 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:21:09 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:21:09 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:21:09 user nova-compute[75071]:   </clock>
Nov 29 13:21:09 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:21:09 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:21:09 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:21:09 user nova-compute[75071]:   </cpu>
Nov 29 13:21:09 user nova-compute[75071]:   <devices>
Nov 29 13:21:09 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:21:09 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:21:09 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk"/>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:21:09 user nova-compute[75071]:     </disk>
Nov 29 13:21:09 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:21:09 user nova-compute[75071]:       <mac address="fa:16:3e:8f:4d:39"/>
Nov 29 13:21:09 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:21:09 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:21:09 user nova-compute[75071]:       <target dev="tap82a84dc1-9f"/>
Nov 29 13:21:09 user nova-compute[75071]:     </interface>
Nov 29 13:21:09 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:21:09 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/console.log" append="off"/>
Nov 29 13:21:09 user nova-compute[75071]:     </serial>
Nov 29 13:21:09 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:21:09 user nova-compute[75071]:     <video>
Nov 29 13:21:09 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:21:09 user nova-compute[75071]:     </video>
Nov 29 13:21:09 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:21:09 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:21:09 user nova-compute[75071]:     </rng>
Nov 29 13:21:09 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:21:09 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:21:09 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:21:09 user nova-compute[75071]:     </memballoon>
Nov 29 13:21:09 user nova-compute[75071]:   </devices>
Nov 29 13:21:09 user nova-compute[75071]: </domain>
Nov 29 13:21:09 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1471014675',display_name='tempest-VolumesAdminNegativeTest-server-1471014675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1471014675',id=13,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5c2c9d59234462091e0e4548c770d12',ramdisk_id='',reservation_id='r-d78gyzoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-984213226',owner_user_name='tempest-VolumesAdminNegativeTest-984213226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:21:09Z,user_data=None,user_id='44500d2105a742ddacaf6e766f042bf2',uuid=2ae7c6e1-1feb-413d-b11d-aa6ff502d292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converting VIF {"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:39,bridge_name='br-int',has_traffic_filtering=True,id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a84dc1-9f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG os_vif [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:39,bridge_name='br-int',has_traffic_filtering=True,id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a84dc1-9f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba3a27a4-05f3-5d76-8a7b-11de5599aff2', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82a84dc1-9f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82a84dc1-9f, col_values=(('qos', UUID('f3f197de-662e-4f85-a54a-dfb5ea06a0f8')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82a84dc1-9f, col_values=(('external_ids', {'iface-id': '82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:4d:39', 'vm-uuid': '2ae7c6e1-1feb-413d-b11d-aa6ff502d292'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:10 user nova-compute[75071]: INFO os_vif [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:39,bridge_name='br-int',has_traffic_filtering=True,id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a84dc1-9f')
Nov 29 13:21:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] No VIF found with MAC fa:16:3e:8f:4d:39, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:21:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Updated VIF entry in instance network info cache for port 82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:21:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Updating instance_info_cache with network_info: [{"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c1da0c13-f578-4548-a5d9-fe80305831bf req-7d7ea444-ac12-4c87-87f9-d776e4325502 service nova] Releasing lock "refresh_cache-2ae7c6e1-1feb-413d-b11d-aa6ff502d292" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-6f3e5694-b50d-4155-accf-b0f54aa580a8 req-50ebcab5-3c05-4943-96bc-fc502abaaf33 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Received event network-vif-plugged-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f3e5694-b50d-4155-accf-b0f54aa580a8 req-50ebcab5-3c05-4943-96bc-fc502abaaf33 service nova] Acquiring lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f3e5694-b50d-4155-accf-b0f54aa580a8 req-50ebcab5-3c05-4943-96bc-fc502abaaf33 service nova] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f3e5694-b50d-4155-accf-b0f54aa580a8 req-50ebcab5-3c05-4943-96bc-fc502abaaf33 service nova] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-6f3e5694-b50d-4155-accf-b0f54aa580a8 req-50ebcab5-3c05-4943-96bc-fc502abaaf33 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] No waiting events found dispatching network-vif-plugged-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:11 user nova-compute[75071]: WARNING nova.compute.manager [req-6f3e5694-b50d-4155-accf-b0f54aa580a8 req-50ebcab5-3c05-4943-96bc-fc502abaaf33 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Received unexpected event network-vif-plugged-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 for instance with vm_state building and task_state spawning.
Nov 29 13:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:21:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Instance spawned successfully.
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-500a9a63-8379-4d67-8ffc-00263b4f3eb1 req-fd518e23-54c1-4bef-adf6-5d76c86068a3 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Received event network-vif-plugged-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-500a9a63-8379-4d67-8ffc-00263b4f3eb1 req-fd518e23-54c1-4bef-adf6-5d76c86068a3 service nova] Acquiring lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-500a9a63-8379-4d67-8ffc-00263b4f3eb1 req-fd518e23-54c1-4bef-adf6-5d76c86068a3 service nova] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-500a9a63-8379-4d67-8ffc-00263b4f3eb1 req-fd518e23-54c1-4bef-adf6-5d76c86068a3 service nova] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-500a9a63-8379-4d67-8ffc-00263b4f3eb1 req-fd518e23-54c1-4bef-adf6-5d76c86068a3 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] No waiting events found dispatching network-vif-plugged-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:13 user nova-compute[75071]: WARNING nova.compute.manager [req-500a9a63-8379-4d67-8ffc-00263b4f3eb1 req-fd518e23-54c1-4bef-adf6-5d76c86068a3 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Received unexpected event network-vif-plugged-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 for instance with vm_state building and task_state spawning.
Nov 29 13:21:13 user nova-compute[75071]: INFO nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 29 13:21:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:21:13 user nova-compute[75071]: INFO nova.compute.manager [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Took 5.69 seconds to build instance.
Nov 29 13:21:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1685c3b7-202c-48d5-ac66-51e40c747105 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.785s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e is timed out.
Nov 29 13:21:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Successfully detached device vdb from instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e from the live domain config.
Nov 29 13:21:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AocnrNSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'b002d748-69aa-4424-a1b6-0ff69a6c797e'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3635a716-ab92-472b-be1f-05eb33ac9f83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:21:17 user nova-compute[75071]: No targets found.
Nov 29 13:21:17 user nova-compute[75071]: iSNS:
Nov 29 13:21:17 user nova-compute[75071]: No targets found.
Nov 29 13:21:17 user nova-compute[75071]: STATIC:
Nov 29 13:21:17 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e
Nov 29 13:21:17 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:21:17 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:21:17 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:21:17 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:21:17 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:21:17 user nova-compute[75071]: FIRMWARE:
Nov 29 13:21:17 user nova-compute[75071]: No targets found.
Nov 29 13:21:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:21:17 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:21:17 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b45373b-6de5-42ca-9f56-0034588420bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f227674-44b0-4177-95f0-62acc07aa100]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:21:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:21:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e (non-flash)
Nov 29 13:21:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:21:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fcbbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ef942f-6a42-4e95-ba71-51dbd7a24fb8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b50a6a-9ddb-4506-8008-232aff9af5ee]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893e734-a478-4a2c-a9bf-2ac779cc3f35]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e6d20-65be-4575-8740-fa43c2300bfe]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.121s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaab0e5-e992-4b87-9eda-bcd2de74a0c8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f61978-c0db-4958-9971-dfcfa560e918]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260]
Nov 29 13:21:18 user nova-compute[75071]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e, portal: 172.16.0.220,3260] successful.
Nov 29 13:21:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b002d748-69aa-4424-a1b6-0ff69a6c797e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f765971f-3d4d-4b1c-9ca0-7b98875969a0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] <== disconnect_volume: return (484ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:21:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lazy-loading 'flavor' on Instance uuid 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c4e4b519-a128-4a8d-9fba-499db7e769bd tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.488s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:28 user nova-compute[75071]: INFO nova.compute.manager [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Terminating instance
Nov 29 13:21:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing instance network info cache due to event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] Acquiring lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] Acquired lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-30fd46ab-eeee-407f-b843-7de38463f17c req-dcbe5edd-2e33-4ba4-a4d8-2804e030a4fe service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received event network-vif-unplugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30fd46ab-eeee-407f-b843-7de38463f17c req-dcbe5edd-2e33-4ba4-a4d8-2804e030a4fe service nova] Acquiring lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30fd46ab-eeee-407f-b843-7de38463f17c req-dcbe5edd-2e33-4ba4-a4d8-2804e030a4fe service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30fd46ab-eeee-407f-b843-7de38463f17c req-dcbe5edd-2e33-4ba4-a4d8-2804e030a4fe service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-30fd46ab-eeee-407f-b843-7de38463f17c req-dcbe5edd-2e33-4ba4-a4d8-2804e030a4fe service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] No waiting events found dispatching network-vif-unplugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-30fd46ab-eeee-407f-b843-7de38463f17c req-dcbe5edd-2e33-4ba4-a4d8-2804e030a4fe service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received event network-vif-unplugged-3dd13435-6faf-46a2-be5a-8b8428abb12b for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:21:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Instance destroyed successfully.
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lazy-loading 'resources' on Instance uuid 9ad6a28c-21f9-468a-b81a-5d1b75e78ede {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1812241087',display_name='tempest-ServersNegativeTestJSON-server-1812241087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1812241087',id=11,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a7845e453c40d59a3fc56db2d3beb0',ramdisk_id='',reservation_id='r-zablm2or',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-308617736',owner_user_name='tempest-ServersNegativeTestJSON-308617736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:19:47Z,user_data=None,user_id='d83bac00dc8a40559ff4b0f0673c79a0',uuid=9ad6a28c-21f9-468a-b81a-5d1b75e78ede,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converting VIF {"id": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "address": "fa:16:3e:7f:60:91", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dd13435-6f", "ovs_interfaceid": "3dd13435-6faf-46a2-be5a-8b8428abb12b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:60:91,bridge_name='br-int',has_traffic_filtering=True,id=3dd13435-6faf-46a2-be5a-8b8428abb12b,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd13435-6f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG os_vif [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:60:91,bridge_name='br-int',has_traffic_filtering=True,id=3dd13435-6faf-46a2-be5a-8b8428abb12b,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd13435-6f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dd13435-6f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4180461-2144-4284-b109-a90a3d4c37a2) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: INFO os_vif [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:60:91,bridge_name='br-int',has_traffic_filtering=True,id=3dd13435-6faf-46a2-be5a-8b8428abb12b,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dd13435-6f')
Nov 29 13:21:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Deleting instance files /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede_del
Nov 29 13:21:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Deletion of /opt/stack/data/nova/instances/9ad6a28c-21f9-468a-b81a-5d1b75e78ede_del complete
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:29 user nova-compute[75071]: INFO nova.compute.manager [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Shelve offloading
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updated VIF entry in instance network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-86b6775f-9192-40cf-8e26-c5d2a0780986 req-60a5ee17-d893-4f45-9e30-1805d8efd540 service nova] Releasing lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:29 user nova-compute[75071]: INFO nova.compute.manager [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 29 13:21:29 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:30 user nova-compute[75071]: INFO nova.compute.manager [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Terminating instance
Nov 29 13:21:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-6030c542-a8a2-4e9c-b1ba-e12ffa867050 req-ef080d19-2041-4ce6-8f9f-9da9b8ea6ea1 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-vif-unplugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6030c542-a8a2-4e9c-b1ba-e12ffa867050 req-ef080d19-2041-4ce6-8f9f-9da9b8ea6ea1 service nova] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6030c542-a8a2-4e9c-b1ba-e12ffa867050 req-ef080d19-2041-4ce6-8f9f-9da9b8ea6ea1 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6030c542-a8a2-4e9c-b1ba-e12ffa867050 req-ef080d19-2041-4ce6-8f9f-9da9b8ea6ea1 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-6030c542-a8a2-4e9c-b1ba-e12ffa867050 req-ef080d19-2041-4ce6-8f9f-9da9b8ea6ea1 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] No waiting events found dispatching network-vif-unplugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-6030c542-a8a2-4e9c-b1ba-e12ffa867050 req-ef080d19-2041-4ce6-8f9f-9da9b8ea6ea1 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-vif-unplugged-d9af1c93-0d38-4750-82e0-caceb792b969 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:21:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance destroyed successfully.
Nov 29 13:21:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquired lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:30 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Took 0.86 seconds to deallocate network for instance.
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Instance destroyed successfully.
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lazy-loading 'resources' on Instance uuid b3791790-3607-48cc-a6f3-d7eceedc6c88 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Releasing lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-130401697',display_name='tempest-VolumesAssistedSnapshotsTest-server-130401697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-130401697',id=8,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPoEJxG331MraWo3pLaYgiXb7M1Q8EYo2H3jg3ajK7lTn5J8xbnXRAIwi3/YywiGYRlm41o3OLD4riYTb2kfnKDf8JcHoedUfSDIvylutKQor1y4QXxOYKK4tMO5gyVxA==',key_name='tempest-keypair-726720716',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97455887212d43b38034f553c20243ca',ramdisk_id='',reservation_id='r-p74oi5y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-901336619',owner_user_name='tempest-VolumesAssistedSnapshotsTest-901336619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8111debc03e84095bbc4a0e6f28b1345',uuid=b3791790-3607-48cc-a6f3-d7eceedc6c88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Converting VIF {"id": "d9af1c93-0d38-4750-82e0-caceb792b969", "address": "fa:16:3e:ff:e7:bb", "network": {"id": "bef850f7-9ac4-487f-b687-2fa830a16f21", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-378462208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97455887212d43b38034f553c20243ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9af1c93-0d", "ovs_interfaceid": "d9af1c93-0d38-4750-82e0-caceb792b969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:e7:bb,bridge_name='br-int',has_traffic_filtering=True,id=d9af1c93-0d38-4750-82e0-caceb792b969,network=Network(bef850f7-9ac4-487f-b687-2fa830a16f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9af1c93-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_vif [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:e7:bb,bridge_name='br-int',has_traffic_filtering=True,id=d9af1c93-0d38-4750-82e0-caceb792b969,network=Network(bef850f7-9ac4-487f-b687-2fa830a16f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9af1c93-0d') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9af1c93-0d, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b718748b-0295-4127-9139-22e4a132967c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: INFO os_vif [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:e7:bb,bridge_name='br-int',has_traffic_filtering=True,id=d9af1c93-0d38-4750-82e0-caceb792b969,network=Network(bef850f7-9ac4-487f-b687-2fa830a16f21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9af1c93-0d')
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Deleting instance files /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88_del
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Deletion of /opt/stack/data/nova/instances/b3791790-3607-48cc-a6f3-d7eceedc6c88_del complete
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.compute.manager [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Deleted allocations for instance 9ad6a28c-21f9-468a-b81a-5d1b75e78ede
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3980cd64-c234-4885-830a-e56427ba83e1 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.352s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received event network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Acquiring lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Lock "9ad6a28c-21f9-468a-b81a-5d1b75e78ede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] No waiting events found dispatching network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:31 user nova-compute[75071]: WARNING nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received unexpected event network-vif-plugged-3dd13435-6faf-46a2-be5a-8b8428abb12b for instance with vm_state deleted and task_state None.
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-unplugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-unplugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:31 user nova-compute[75071]: WARNING nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received unexpected event network-vif-unplugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with vm_state active and task_state shelving.
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:31 user nova-compute[75071]: WARNING nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received unexpected event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with vm_state active and task_state shelving.
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-e85cd0d8-97f5-49de-bb0a-9d81e48300a6 req-0b7e8f18-16f0-435e-8c2f-977bd775a5dd service nova] [instance: 9ad6a28c-21f9-468a-b81a-5d1b75e78ede] Received event network-vif-deleted-3dd13435-6faf-46a2-be5a-8b8428abb12b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance destroyed successfully.
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'resources' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-878992995',display_name='tempest-TestShelveInstance-server-878992995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-878992995',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3l5psQ+RFAOK4Bmf81fxopedVDeR2Xv3emIdqPVEMZ4lQ3fRN6u7br81LSROFbo78BoT0QVP3ZpQw2is7bxCC+v9VSWxo9qONy36RA8t5MnIp983IR0xu8Al/0PDLpvQ==',key_name='tempest-TestShelveInstance-76113716',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:20:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e33dac7a205d476ba368ab85fa20387d',ramdisk_id='',reservation_id='r-3amg8rr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-260027550',owner_user_name='tempest-TestShelveInstance-260027550-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:20:05Z,user_data=None,user_id='754229134eaf4fd18d8b0680e74ddd90',uuid=89d407c4-7e0e-4213-a2a2-99d547c42a4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converting VIF {"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_vif [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb73234-ca, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4684fa3-1053-449e-9feb-b1105f0b78b5) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:31 user nova-compute[75071]: INFO os_vif [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca')
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e5969-71ce-4a4c-8096-df422f8927c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:21:31 user nova-compute[75071]: No targets found.
Nov 29 13:21:31 user nova-compute[75071]: iSNS:
Nov 29 13:21:31 user nova-compute[75071]: No targets found.
Nov 29 13:21:31 user nova-compute[75071]: STATIC:
Nov 29 13:21:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:21:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:21:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:21:31 user nova-compute[75071]: FIRMWARE:
Nov 29 13:21:31 user nova-compute[75071]: No targets found.
Nov 29 13:21:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:21:31 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:21:31 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd48c15-dfd3-4a7f-9b94-45aca391bcb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd8c9cb-84e1-4609-ba0f-7ca95a2c36af]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:21:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:21:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148351000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f452fa3-fde8-4302-a089-9024250ce1b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4c564-cb8a-4a24-aacc-e2d9393fd692]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61fb754-76e8-41cc-b08f-1252382741f7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3854bb-9212-45b7-b55e-13bdb942388b]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef0329f-9884-4777-80e1-320fe1372910]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-2509a25e-1cd0-4e34-8226-eea582593b64 req-c78efdc6-f82b-4095-9255-47b9faabb17f service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-vif-deleted-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.compute.manager [req-2509a25e-1cd0-4e34-8226-eea582593b64 req-c78efdc6-f82b-4095-9255-47b9faabb17f service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Neutron deleted interface d9af1c93-0d38-4750-82e0-caceb792b969; detaching it from the instance and deleting it from the info cache
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-2509a25e-1cd0-4e34-8226-eea582593b64 req-c78efdc6-f82b-4095-9255-47b9faabb17f service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Took 0.74 seconds to deallocate network for instance.
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-2509a25e-1cd0-4e34-8226-eea582593b64 req-c78efdc6-f82b-4095-9255-47b9faabb17f service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Detach interface failed, port_id=d9af1c93-0d38-4750-82e0-caceb792b969, reason: Instance b3791790-3607-48cc-a6f3-d7eceedc6c88 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c10dfc2-34fc-41f9-8c86-4167373f35b2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]
Nov 29 13:21:31 user nova-compute[75071]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.
Nov 29 13:21:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e05d3b4-071c-4e92-861b-d22b69f0cc9f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] <== disconnect_volume: return (303ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Deleting instance files /opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c_del
Nov 29 13:21:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Deletion of /opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c_del complete
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:32 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Deleted allocations for instance b3791790-3607-48cc-a6f3-d7eceedc6c88
Nov 29 13:21:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-871d1d5f-bb4f-4ad2-aa76-c8d293a101fc tempest-VolumesAssistedSnapshotsTest-901336619 tempest-VolumesAssistedSnapshotsTest-901336619-project-member] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.367s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-152f568d-9a51-4f80-8a1d-f7ee4e5bf2c9 req-5a9782ad-81b2-4b32-a7e6-653ae76ff923 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received event network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-152f568d-9a51-4f80-8a1d-f7ee4e5bf2c9 req-5a9782ad-81b2-4b32-a7e6-653ae76ff923 service nova] Acquiring lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-152f568d-9a51-4f80-8a1d-f7ee4e5bf2c9 req-5a9782ad-81b2-4b32-a7e6-653ae76ff923 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-152f568d-9a51-4f80-8a1d-f7ee4e5bf2c9 req-5a9782ad-81b2-4b32-a7e6-653ae76ff923 service nova] Lock "b3791790-3607-48cc-a6f3-d7eceedc6c88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-152f568d-9a51-4f80-8a1d-f7ee4e5bf2c9 req-5a9782ad-81b2-4b32-a7e6-653ae76ff923 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] No waiting events found dispatching network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:32 user nova-compute[75071]: WARNING nova.compute.manager [req-152f568d-9a51-4f80-8a1d-f7ee4e5bf2c9 req-5a9782ad-81b2-4b32-a7e6-653ae76ff923 service nova] [instance: b3791790-3607-48cc-a6f3-d7eceedc6c88] Received unexpected event network-vif-plugged-d9af1c93-0d38-4750-82e0-caceb792b969 for instance with vm_state deleted and task_state None.
Nov 29 13:21:32 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Deleted allocations for instance 89d407c4-7e0e-4213-a2a2-99d547c42a4c
Nov 29 13:21:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'numa_topology' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG nova.objects.base [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Object Instance<89d407c4-7e0e-4213-a2a2-99d547c42a4c> lazy-loaded attributes: resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7603fc54-bf84-4afa-8d4e-12985f7b8cd0 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.734s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:21:37 user nova-compute[75071]: INFO nova.compute.claims [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Claim successful on node user
Nov 29 13:21:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:21:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.policy [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8395b32f70af4fd782ad81a609e9f63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5f5e7553949989e7fc90db828a0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:21:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Creating image(s)
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk 1073741824" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:39 user nova-compute[75071]: INFO nova.compute.manager [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Terminating instance
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Successfully created port: b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-49437a94-e20b-4ab7-bd07-8587d579f3be req-6dbf5bb7-b332-464a-91fe-d66b82000722 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-unplugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49437a94-e20b-4ab7-bd07-8587d579f3be req-6dbf5bb7-b332-464a-91fe-d66b82000722 service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49437a94-e20b-4ab7-bd07-8587d579f3be req-6dbf5bb7-b332-464a-91fe-d66b82000722 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49437a94-e20b-4ab7-bd07-8587d579f3be req-6dbf5bb7-b332-464a-91fe-d66b82000722 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-49437a94-e20b-4ab7-bd07-8587d579f3be req-6dbf5bb7-b332-464a-91fe-d66b82000722 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-unplugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-49437a94-e20b-4ab7-bd07-8587d579f3be req-6dbf5bb7-b332-464a-91fe-d66b82000722 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-unplugged-254915cd-7b23-4208-a5bf-af1133dc3493 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Cannot resize image /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Ensure instance console log exists: /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:21:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Instance destroyed successfully.
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lazy-loading 'resources' on Instance uuid 2a30460f-0839-4256-a3b8-0c6e170fbe4b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-40624585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-40624585',id=6,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYquPLfixyMfcOqFmtqYEY2Cmj3H1VOzLAyORHfrRmWw3ZFmY107sbMPS02Ktg30EKuUqo+W+Vf1Bm6Hid/03g/X+HHC+/obqh1L45A1MeghyOuCoVjw5lEqINLmuo7w==',key_name='tempest-keypair-1054494551',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d794844d6bd7438dba426da0c83eea2e',ramdisk_id='',reservation_id='r-ydnw93ec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-800730260',owner_user_name='tempest-TaggedAttachmentsTest-800730260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2620d9a6cc1b4f789bdb2cb0827fee65',uuid=2a30460f-0839-4256-a3b8-0c6e170fbe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converting VIF {"id": "254915cd-7b23-4208-a5bf-af1133dc3493", "address": "fa:16:3e:8f:c5:4a", "network": {"id": "1ed47474-7d3b-43a0-8f30-804fffb270a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-349455493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d794844d6bd7438dba426da0c83eea2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254915cd-7b", "ovs_interfaceid": "254915cd-7b23-4208-a5bf-af1133dc3493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c5:4a,bridge_name='br-int',has_traffic_filtering=True,id=254915cd-7b23-4208-a5bf-af1133dc3493,network=Network(1ed47474-7d3b-43a0-8f30-804fffb270a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254915cd-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG os_vif [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c5:4a,bridge_name='br-int',has_traffic_filtering=True,id=254915cd-7b23-4208-a5bf-af1133dc3493,network=Network(1ed47474-7d3b-43a0-8f30-804fffb270a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254915cd-7b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254915cd-7b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16ef8114-2fa6-4e02-9a3b-761c0714d4de) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:40 user nova-compute[75071]: INFO os_vif [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c5:4a,bridge_name='br-int',has_traffic_filtering=True,id=254915cd-7b23-4208-a5bf-af1133dc3493,network=Network(1ed47474-7d3b-43a0-8f30-804fffb270a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254915cd-7b')
Nov 29 13:21:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Deleting instance files /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b_del
Nov 29 13:21:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Deletion of /opt/stack/data/nova/instances/2a30460f-0839-4256-a3b8-0c6e170fbe4b_del complete
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Successfully updated port: b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:21:40 user nova-compute[75071]: INFO nova.compute.manager [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquired lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-changed-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Refreshing instance network info cache due to event network-changed-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] Acquiring lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:40 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Took 0.71 seconds to deallocate network for instance.
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updating instance_info_cache with network_info: [{"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Releasing lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance network_info: |[{"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] Acquired lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Refreshing network info cache for port b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Start _get_guest_xml network_info=[{"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:21:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1695895604',display_name='tempest-tempest.common.compute-instance-1695895604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1695895604',id=14,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/BEBsu8SWQyVo+EcpBRy6SlkamoX5CmQ7XusjEdiTF0jfoalIP8ATzoKuWNZR7C/WHWOVQ9RJolPyVo3wBS3c6D10E/7lFvIfa8WcYKX9M3zt4uF7yzhKQCoeIPMhBnw==',key_name='tempest-keypair-1558894449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dp042j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=05b48a8b-440a-4af0-81fa-d362302c1bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'pci_devices' on Instance uuid 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:21:41 user nova-compute[75071]:   <uuid>05b48a8b-440a-4af0-81fa-d362302c1bb8</uuid>
Nov 29 13:21:41 user nova-compute[75071]:   <name>instance-0000000e</name>
Nov 29 13:21:41 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:21:41 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:21:41 user nova-compute[75071]:   <metadata>
Nov 29 13:21:41 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:21:41 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:21:41 user nova-compute[75071]:       <nova:name>tempest-tempest.common.compute-instance-1695895604</nova:name>
Nov 29 13:21:41 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:21:41</nova:creationTime>
Nov 29 13:21:41 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:21:41 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:21:41 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:21:41 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:21:41 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:21:41 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:21:41 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:21:41 user nova-compute[75071]:       <nova:owner>
Nov 29 13:21:41 user nova-compute[75071]:         <nova:user uuid="8395b32f70af4fd782ad81a609e9f63a">tempest-ServerActionsTestOtherA-611751521-project-member</nova:user>
Nov 29 13:21:41 user nova-compute[75071]:         <nova:project uuid="36f5f5e7553949989e7fc90db828a0bd">tempest-ServerActionsTestOtherA-611751521</nova:project>
Nov 29 13:21:41 user nova-compute[75071]:       </nova:owner>
Nov 29 13:21:41 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:21:41 user nova-compute[75071]:       <nova:ports>
Nov 29 13:21:41 user nova-compute[75071]:         <nova:port uuid="b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14">
Nov 29 13:21:41 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:21:41 user nova-compute[75071]:         </nova:port>
Nov 29 13:21:41 user nova-compute[75071]:       </nova:ports>
Nov 29 13:21:41 user nova-compute[75071]:     </nova:instance>
Nov 29 13:21:41 user nova-compute[75071]:   </metadata>
Nov 29 13:21:41 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:21:41 user nova-compute[75071]:     <system>
Nov 29 13:21:41 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:21:41 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:21:41 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:21:41 user nova-compute[75071]:       <entry name="serial">05b48a8b-440a-4af0-81fa-d362302c1bb8</entry>
Nov 29 13:21:41 user nova-compute[75071]:       <entry name="uuid">05b48a8b-440a-4af0-81fa-d362302c1bb8</entry>
Nov 29 13:21:41 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:21:41 user nova-compute[75071]:     </system>
Nov 29 13:21:41 user nova-compute[75071]:   </sysinfo>
Nov 29 13:21:41 user nova-compute[75071]:   <os>
Nov 29 13:21:41 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:21:41 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:21:41 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:21:41 user nova-compute[75071]:   </os>
Nov 29 13:21:41 user nova-compute[75071]:   <features>
Nov 29 13:21:41 user nova-compute[75071]:     <acpi/>
Nov 29 13:21:41 user nova-compute[75071]:     <apic/>
Nov 29 13:21:41 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:21:41 user nova-compute[75071]:   </features>
Nov 29 13:21:41 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:21:41 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:21:41 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:21:41 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:21:41 user nova-compute[75071]:   </clock>
Nov 29 13:21:41 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:21:41 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:21:41 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:21:41 user nova-compute[75071]:   </cpu>
Nov 29 13:21:41 user nova-compute[75071]:   <devices>
Nov 29 13:21:41 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:21:41 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:21:41 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk"/>
Nov 29 13:21:41 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:21:41 user nova-compute[75071]:     </disk>
Nov 29 13:21:41 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:21:41 user nova-compute[75071]:       <mac address="fa:16:3e:1f:41:4b"/>
Nov 29 13:21:41 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:21:41 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:21:41 user nova-compute[75071]:       <target dev="tapb3ce1c68-dc"/>
Nov 29 13:21:41 user nova-compute[75071]:     </interface>
Nov 29 13:21:41 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:21:41 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/console.log" append="off"/>
Nov 29 13:21:41 user nova-compute[75071]:     </serial>
Nov 29 13:21:41 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:21:41 user nova-compute[75071]:     <video>
Nov 29 13:21:41 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:21:41 user nova-compute[75071]:     </video>
Nov 29 13:21:41 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:21:41 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:21:41 user nova-compute[75071]:     </rng>
Nov 29 13:21:41 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:21:41 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:21:41 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:21:41 user nova-compute[75071]:     </memballoon>
Nov 29 13:21:41 user nova-compute[75071]:   </devices>
Nov 29 13:21:41 user nova-compute[75071]: </domain>
Nov 29 13:21:41 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1695895604',display_name='tempest-tempest.common.compute-instance-1695895604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1695895604',id=14,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/BEBsu8SWQyVo+EcpBRy6SlkamoX5CmQ7XusjEdiTF0jfoalIP8ATzoKuWNZR7C/WHWOVQ9RJolPyVo3wBS3c6D10E/7lFvIfa8WcYKX9M3zt4uF7yzhKQCoeIPMhBnw==',key_name='tempest-keypair-1558894449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dp042j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=05b48a8b-440a-4af0-81fa-d362302c1bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG os_vif [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '751e78fe-e955-5a69-999a-213b10cc3f66', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3ce1c68-dc, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3ce1c68-dc, col_values=(('qos', UUID('6f3e6995-2e71-4bca-8628-c7cd15f441b9')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3ce1c68-dc, col_values=(('external_ids', {'iface-id': 'b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:41:4b', 'vm-uuid': '05b48a8b-440a-4af0-81fa-d362302c1bb8'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:41 user nova-compute[75071]: INFO os_vif [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc')
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No VIF found with MAC fa:16:3e:1f:41:4b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:41 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Deleted allocations for instance 2a30460f-0839-4256-a3b8-0c6e170fbe4b
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updated VIF entry in instance network info cache for port b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updating instance_info_cache with network_info: [{"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9837dc33-729d-42b7-956f-7887ead91690 tempest-TaggedAttachmentsTest-800730260 tempest-TaggedAttachmentsTest-800730260-project-member] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.369s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dac41fcd-12ee-446e-817c-ed11607fa1df req-456feaaf-d018-404e-9220-bdc5053737ad service nova] Releasing lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-ddee0dd6-2704-4c9b-a803-3a16f84f7ec6 req-21895055-2c52-429c-810e-5f9feb9c0124 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ddee0dd6-2704-4c9b-a803-3a16f84f7ec6 req-21895055-2c52-429c-810e-5f9feb9c0124 service nova] Acquiring lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ddee0dd6-2704-4c9b-a803-3a16f84f7ec6 req-21895055-2c52-429c-810e-5f9feb9c0124 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ddee0dd6-2704-4c9b-a803-3a16f84f7ec6 req-21895055-2c52-429c-810e-5f9feb9c0124 service nova] Lock "2a30460f-0839-4256-a3b8-0c6e170fbe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-ddee0dd6-2704-4c9b-a803-3a16f84f7ec6 req-21895055-2c52-429c-810e-5f9feb9c0124 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] No waiting events found dispatching network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:41 user nova-compute[75071]: WARNING nova.compute.manager [req-ddee0dd6-2704-4c9b-a803-3a16f84f7ec6 req-21895055-2c52-429c-810e-5f9feb9c0124 service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received unexpected event network-vif-plugged-254915cd-7b23-4208-a5bf-af1133dc3493 for instance with vm_state deleted and task_state None.
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-7743def9-77fa-41ca-80bf-a944653ce433 req-ed464089-bafc-4674-b18a-232a024d079a service nova] [instance: 2a30460f-0839-4256-a3b8-0c6e170fbe4b] Received event network-vif-deleted-254915cd-7b23-4208-a5bf-af1133dc3493 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid '2a30460f-0839-4256-a3b8-0c6e170fbe4b' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid '2a30460f-0839-4256-a3b8-0c6e170fbe4b' (instance-00000006)
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG nova.objects.instance [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'flavor' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:43 user nova-compute[75071]: INFO nova.compute.manager [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Attaching volume 883dbcb6-4f9d-4469-ab00-47c241d1ef55 to /dev/vdb
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG os_brick.utils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8bd817-63e5-46f2-b6be-cc8e361033fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37479bcb-8174-4c0e-a5b2-dc0ec5cbd4da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd6055b-8ca5-4bfe-9650-0fa22e52c6d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f16879-330a-4b3b-8e1f-8700728dd9b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:21:43 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ef9cc-fc64-4619-a5ef-b1cb9b7a3a1f]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG os_brick.utils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating existing volume attachment record: 5ac7c88e-4c72-43b4-be88-3c94e2ac39d4 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:45 user nova-compute[75071]: WARNING nova.compute.manager [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received unexpected event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with vm_state building and task_state spawning.
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:45 user nova-compute[75071]: WARNING nova.compute.manager [req-738a3544-c76b-45a2-a51f-43742d20bbfe req-c13bfb7e-b715-41a9-ae4f-28034758297a service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received unexpected event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with vm_state building and task_state spawning.
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:21:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7852MB free_disk=25.332500457763672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'flavor' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lazy-loading 'flavor' on Instance uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance spawned successfully.
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:45 user nova-compute[75071]: INFO nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 014f79bb-e808-49e1-8d7a-c058b99c8377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 2ae7c6e1-1feb-413d-b11d-aa6ff502d292 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:45 user nova-compute[75071]: INFO nova.compute.manager [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Attaching volume 52ea8ca0-7566-45a8-bcbe-b944f1fd6689 to /dev/vdb
Nov 29 13:21:45 user nova-compute[75071]: INFO nova.compute.manager [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Took 7.61 seconds to build instance.
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32f57cb0-f3aa-4b19-bb76-c827a9ffa19e tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.767s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:45 user nova-compute[75071]: INFO nova.compute.manager [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Attaching volume 789d9c7e-beb3-4dd9-9a2d-f47aaf07474a to /dev/vdb
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.utils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c179c6d-7fd6-49a9-95e6-ef31b2f5dd2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.utils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80c5299-3f72-490b-9bca-e59541c19a5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[130085a6-fb3b-43c8-a368-32cb367df318]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[600cf8e5-4a7a-4f18-b5a6-0f60e6f87a4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b748ecc-9231-4ba9-a249-a200ce778e65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d9b91b-a6d0-48b5-98fe-4d1f3fe3bc15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:21:45 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd142f-6a3b-4149-8cc7-264286fed8b3]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.utils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating existing volume attachment record: 47474ae2-dc31-4f20-8a16-8168d8085aeb {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac3e230-8ace-4e9c-9de4-6a5639428faa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f6f9de-832d-4b19-9ef0-62631a986eb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:21:45 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c682400-907a-4347-8ce1-fc726e354c14]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG os_brick.utils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== get_connector_properties: return (212ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating existing volume attachment record: fc7ece40-9908-43ea-8869-9cd0176e13eb {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:21:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:21:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNyqeDUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:50 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:21:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a5df0-9c2a-4455-8011-84521ca49f8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:21:50 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5731300-5441-4487-b990-951f5af2454e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55] added
Nov 29 13:21:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2520bbd-444a-4ae4-9825-3e70dae7b698]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[420edf55-ded0-409a-ad24-bf6a24a9f091]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNyqeDUW {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNyqeDUW" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e9a1e-e14d-486d-8de7-1dc92d2660d3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNyqeDUW'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddb8e72-cc88-4448-8c99-5990491fe7be]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95413dea-2177-471a-b851-4fae75c4257b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:21:51 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:21:51 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:51 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:21:51 user nova-compute[75071]: 
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:51 user nova-compute[75071]: INFO nova.compute.manager [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Terminating instance
Nov 29 13:21:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-b78f41d6-edcc-4951-97e6-addb2cd390d0 req-cd3261fa-0133-4d9c-a3ce-4080bd5b3e2b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-vif-unplugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b78f41d6-edcc-4951-97e6-addb2cd390d0 req-cd3261fa-0133-4d9c-a3ce-4080bd5b3e2b service nova] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b78f41d6-edcc-4951-97e6-addb2cd390d0 req-cd3261fa-0133-4d9c-a3ce-4080bd5b3e2b service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b78f41d6-edcc-4951-97e6-addb2cd390d0 req-cd3261fa-0133-4d9c-a3ce-4080bd5b3e2b service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-b78f41d6-edcc-4951-97e6-addb2cd390d0 req-cd3261fa-0133-4d9c-a3ce-4080bd5b3e2b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] No waiting events found dispatching network-vif-unplugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-b78f41d6-edcc-4951-97e6-addb2cd390d0 req-cd3261fa-0133-4d9c-a3ce-4080bd5b3e2b service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-vif-unplugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:21:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Instance destroyed successfully.
Nov 29 13:21:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lazy-loading 'resources' on Instance uuid 5664a867-ffa0-4aae-9794-ee14a7d91e5e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-106103599',display_name='tempest-TestVolumeSwap-server-106103599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-106103599',id=7,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF+qoEkIsAIWPpe2Qm4etH1BWoFZWwXWVIJLzw5UzZ62LlKN6Eakai2q5Z7pdCV2uVFKSv8/iosc/e+m7/QbX8NjrccrwxSI4veM9mRNgzQb9BRpKbhs9kW5dyaYQsr8A==',key_name='tempest-keypair-578077132',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fecee9fee7f421cbc31c6f7516e70bf',ramdisk_id='',reservation_id='r-198935b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-758044431',owner_user_name='tempest-TestVolumeSwap-758044431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e07fd91c5184066b47081801acfa583',uuid=5664a867-ffa0-4aae-9794-ee14a7d91e5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Converting VIF {"id": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "address": "fa:16:3e:20:96:a8", "network": {"id": "d131dd97-13f1-445c-af46-7c9c7e3527b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-673388036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fecee9fee7f421cbc31c6f7516e70bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9ea24-ad", "ovs_interfaceid": "c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:96:a8,bridge_name='br-int',has_traffic_filtering=True,id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4,network=Network(d131dd97-13f1-445c-af46-7c9c7e3527b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9ea24-ad') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_vif [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:96:a8,bridge_name='br-int',has_traffic_filtering=True,id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4,network=Network(d131dd97-13f1-445c-af46-7c9c7e3527b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9ea24-ad') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3e9ea24-ad, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1705c3c9-8fc1-4e1a-acdb-27010523aecd) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:21:52 user nova-compute[75071]: INFO os_vif [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:96:a8,bridge_name='br-int',has_traffic_filtering=True,id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4,network=Network(d131dd97-13f1-445c-af46-7c9c7e3527b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9ea24-ad')
Nov 29 13:21:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Deleting instance files /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e_del
Nov 29 13:21:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Deletion of /opt/stack/data/nova/instances/5664a867-ffa0-4aae-9794-ee14a7d91e5e_del complete
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --login" returned: 0 in 1.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6840b1ed-db29-42d1-ad13-799f5e53f02b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]
Nov 29 13:21:52 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.
Nov 29 13:21:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2dc74e-f9c4-42b6-904e-951d5786910f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:52 user nova-compute[75071]: INFO nova.compute.manager [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b229b7-b56b-4e77-841b-8ae8d08834e8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f61bea-dfe4-4dd3-8e6f-ac98352679f5]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:21:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNyqeDUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-feb5b7e2-31bd-4407-95db-9b3966ae6c82 req-b91cc04c-8d16-4858-8e18-58ad2cc077fc service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-vif-deleted-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:53 user nova-compute[75071]: INFO nova.compute.manager [req-feb5b7e2-31bd-4407-95db-9b3966ae6c82 req-b91cc04c-8d16-4858-8e18-58ad2cc077fc service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Neutron deleted interface c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4; detaching it from the instance and deleting it from the info cache
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-feb5b7e2-31bd-4407-95db-9b3966ae6c82 req-b91cc04c-8d16-4858-8e18-58ad2cc077fc service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:53 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Took 1.03 seconds to deallocate network for instance.
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-feb5b7e2-31bd-4407-95db-9b3966ae6c82 req-b91cc04c-8d16-4858-8e18-58ad2cc077fc service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Detach interface failed, port_id=c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4, reason: Instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.331s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== connect_volume: return (2334ms) {'type': 'block', 'scsi_wwn': '26131663036306662', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131663036306662', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'flavor' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:21:53 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:21:53 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:21:53 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:21:53 user nova-compute[75071]:   <serial>883dbcb6-4f9d-4469-ab00-47c241d1ef55</serial>
Nov 29 13:21:53 user nova-compute[75071]: </disk>
Nov 29 13:21:53 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:53 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Deleted allocations for instance 5664a867-ffa0-4aae-9794-ee14a7d91e5e
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:53 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-3501fa00-3c96-4237-8f05-f0dc4b8152ff req-d29241a7-0014-4e56-bb7f-d0d9a9172a08 service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received event network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3501fa00-3c96-4237-8f05-f0dc4b8152ff req-d29241a7-0014-4e56-bb7f-d0d9a9172a08 service nova] Acquiring lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3501fa00-3c96-4237-8f05-f0dc4b8152ff req-d29241a7-0014-4e56-bb7f-d0d9a9172a08 service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3501fa00-3c96-4237-8f05-f0dc4b8152ff req-d29241a7-0014-4e56-bb7f-d0d9a9172a08 service nova] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-3501fa00-3c96-4237-8f05-f0dc4b8152ff req-d29241a7-0014-4e56-bb7f-d0d9a9172a08 service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] No waiting events found dispatching network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:53 user nova-compute[75071]: WARNING nova.compute.manager [req-3501fa00-3c96-4237-8f05-f0dc4b8152ff req-d29241a7-0014-4e56-bb7f-d0d9a9172a08 service nova] [instance: 5664a867-ffa0-4aae-9794-ee14a7d91e5e] Received unexpected event network-vif-plugged-c3e9ea24-ad80-4b0b-9217-ee2e10a4a1a4 for instance with vm_state deleted and task_state None.
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc16b03-16a2-480d-bda2-2b26d42b9a3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:21:53 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b037d880-afad-4547-9ec3-e97c2048ffd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a] added
Nov 29 13:21:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edf5609-93b7-42c3-98e9-05474859dcfb]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eeced49d-dd34-4ec2-b196-670fcf686ef3 tempest-TestVolumeSwap-758044431 tempest-TestVolumeSwap-758044431-project-member] Lock "5664a867-ffa0-4aae-9794-ee14a7d91e5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.569s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f685187-8cfc-44a7-96f3-e480a91ffc16]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYSqnbVO {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No VIF found with MAC fa:16:3e:90:2e:ad, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYSqnbVO" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a7d966-c3a4-46ef-a4d2-c3713e4742cf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZYSqnbVO'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[992738bd-70ad-4870-bbc4-8b8467fe15a6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajBQoicf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:21:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad65b6-201f-45ba-84d3-b0f8ec0d7a35]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d070a157-a86d-4f1d-b66e-94ef4d58e035]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]
Nov 29 13:21:54 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.
Nov 29 13:21:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cc8adbac-459e-44f4-9eb9-7c1689d6fdc7 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.868s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f06efa-0aed-458a-9be7-8c477908d6cb]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a49b994-2300-430e-898c-512ffe38c503]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:54 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:21:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:54 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:21:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c58ff6e-b709-465d-96bb-62fd58d8c701]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:21:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26464613365623430', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464613365623430', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.190s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:21:55 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lazy-loading 'flavor' on Instance uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e04e818-0e8b-419b-9fac-d12dc5194053]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:21:55 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.091s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa8cd86-bbf4-461c-b4fb-d64785a121e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689] added
Nov 29 13:21:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:21:55 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:21:55 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:21:55 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:21:55 user nova-compute[75071]:   <serial>789d9c7e-beb3-4dd9-9a2d-f47aaf07474a</serial>
Nov 29 13:21:55 user nova-compute[75071]: </disk>
Nov 29 13:21:55 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bfe13a-1a53-4695-8e35-187da3700a7e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9060dac7-6e0e-4871-8b55-43fc5c312721]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajBQoicf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajBQoicf" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f5c0a4-e41e-4fd9-b904-9571ed4c9de6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajBQoicf'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f330a4-ea5d-4224-8b71-3f36ee05fc0b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeb5e43-e2ed-4c2b-8c5e-1987c35584f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:55 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:21:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:55 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:21:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c09bdf-83e5-469e-b0f3-5b50b935ec1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260]
Nov 29 13:21:55 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260] successful.
Nov 29 13:21:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a0751d-1eb7-4c05-aa54-30ab08b92a2f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[056fa01d-db6c-460d-bffe-c8d34a31f599]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:55 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:21:55 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:21:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:21:55 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:21:55 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:21:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[712e6f0b-01a6-45d7-8851-6efd68f2bfcb]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajBQoicf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No VIF found with MAC fa:16:3e:92:79:29, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:21:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f5a9fd8-b66e-48ac-a19e-bc0a4443683d tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.367s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:21:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] <== connect_volume: return (2654ms) {'type': 'block', 'scsi_wwn': '23364313134386563', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:21:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364313134386563', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:21:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'flavor' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:21:56 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:21:56 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:21:56 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:21:56 user nova-compute[75071]:   <serial>52ea8ca0-7566-45a8-bcbe-b944f1fd6689</serial>
Nov 29 13:21:56 user nova-compute[75071]: </disk>
Nov 29 13:21:56 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:21:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:21:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No VIF found with MAC fa:16:3e:00:b2:03, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:21:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-850bc14f-3309-4b45-9544-7c4e946c7a5d tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.919s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:58 user nova-compute[75071]: INFO nova.compute.manager [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Rescuing
Nov 29 13:21:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Stashing vm_state: active {{(pid=75071) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb01fff6-11d8-4aad-ab3b-e04197c3d3fc req-e0542f68-30dd-4649-b2de-222a85ac60d1 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb01fff6-11d8-4aad-ab3b-e04197c3d3fc req-e0542f68-30dd-4649-b2de-222a85ac60d1 service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb01fff6-11d8-4aad-ab3b-e04197c3d3fc req-e0542f68-30dd-4649-b2de-222a85ac60d1 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb01fff6-11d8-4aad-ab3b-e04197c3d3fc req-e0542f68-30dd-4649-b2de-222a85ac60d1 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb01fff6-11d8-4aad-ab3b-e04197c3d3fc req-e0542f68-30dd-4649-b2de-222a85ac60d1 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:21:58 user nova-compute[75071]: WARNING nova.compute.manager [req-eb01fff6-11d8-4aad-ab3b-e04197c3d3fc req-e0542f68-30dd-4649-b2de-222a85ac60d1 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state active and task_state rescuing.
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:21:59 user nova-compute[75071]: INFO nova.compute.claims [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Claim successful on node user
Nov 29 13:21:59 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating resource usage from migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d
Nov 29 13:21:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance destroyed successfully.
Nov 29 13:21:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Attempting a stable device rescue
Nov 29 13:21:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:21:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Creating image(s)
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.077s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'trusted_certs' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "3d7dd3777ea1fab614b99e39b00b38189de5b192" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "3d7dd3777ea1fab614b99e39b00b38189de5b192" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.657s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:21:59 user nova-compute[75071]: INFO nova.compute.manager [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Migrating
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:59 user nova-compute[75071]: INFO nova.compute.rpcapi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:21:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-1a80c2df-d104-4067-96b7-720122370fcf req-96605da7-2dd9-4e2d-accb-475c83f4db08 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a80c2df-d104-4067-96b7-720122370fcf req-96605da7-2dd9-4e2d-accb-475c83f4db08 service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a80c2df-d104-4067-96b7-720122370fcf req-96605da7-2dd9-4e2d-accb-475c83f4db08 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a80c2df-d104-4067-96b7-720122370fcf req-96605da7-2dd9-4e2d-accb-475c83f4db08 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-1a80c2df-d104-4067-96b7-720122370fcf req-96605da7-2dd9-4e2d-accb-475c83f4db08 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:01 user nova-compute[75071]: WARNING nova.compute.manager [req-1a80c2df-d104-4067-96b7-720122370fcf req-96605da7-2dd9-4e2d-accb-475c83f4db08 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state active and task_state rescuing.
Nov 29 13:22:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG nova.virt.images [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] 99862b29-aea4-4501-ae37-a0ea6d5a162a was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.part /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Starting migrate_disk_and_power_off {{(pid=75071) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.part /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.converted" returned: 0 in 0.482s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "3d7dd3777ea1fab614b99e39b00b38189de5b192" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.920s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "3d7dd3777ea1fab614b99e39b00b38189de5b192" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "3d7dd3777ea1fab614b99e39b00b38189de5b192" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-948facde-2704-4bd5-a0ba-e19ec98dfe79 req-7811280b-f853-42cd-8cec-16fb567a151d service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-unplugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-948facde-2704-4bd5-a0ba-e19ec98dfe79 req-7811280b-f853-42cd-8cec-16fb567a151d service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-948facde-2704-4bd5-a0ba-e19ec98dfe79 req-7811280b-f853-42cd-8cec-16fb567a151d service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-948facde-2704-4bd5-a0ba-e19ec98dfe79 req-7811280b-f853-42cd-8cec-16fb567a151d service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-948facde-2704-4bd5-a0ba-e19ec98dfe79 req-7811280b-f853-42cd-8cec-16fb567a151d service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-unplugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:02 user nova-compute[75071]: WARNING nova.compute.manager [req-948facde-2704-4bd5-a0ba-e19ec98dfe79 req-7811280b-f853-42cd-8cec-16fb567a151d service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-unplugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state active and task_state resize_migrating.
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192 --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192,backing_fmt=raw /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192,backing_fmt=raw /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue" returned: 0 in 0.049s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "3d7dd3777ea1fab614b99e39b00b38189de5b192" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'migration_context' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Object Instance<ef8e7624-0193-4ba9-ae01-0a3a140f7a67> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Start _get_guest_xml network_info=[{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "vif_mac": "fa:16:3e:00:b2:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '99862b29-aea4-4501-ae37-a0ea6d5a162a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajBQoicf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ef8e7624-0193-4ba9-ae01-0a3a140f7a67', 'attached_at': '', 'detached_at': '', 'volume_id': '52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 'serial': '52ea8ca0-7566-45a8-bcbe-b944f1fd6689'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '47474ae2-dc31-4f20-8a16-8168d8085aeb', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'resources' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Object Instance<ef8e7624-0193-4ba9-ae01-0a3a140f7a67> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'numa_topology' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Object Instance<ef8e7624-0193-4ba9-ae01-0a3a140f7a67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.objects.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Object Instance<ef8e7624-0193-4ba9-ae01-0a3a140f7a67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajBQoicf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:22:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:02 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance destroyed successfully.
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1449639590-network", "vif_mac": "fa:16:3e:92:79:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1449639590-network", "vif_mac": "fa:16:3e:92:79:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG os_vif [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10d0cfed-e7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23728f2c-8016-4b50-8615-eb6ead4a3d7a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ajBQoicf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 13:22:02 user nova-compute[75071]: node.name = iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:22:02 user nova-compute[75071]: node.tpgt = -1
Nov 29 13:22:02 user nova-compute[75071]: node.startup = automatic
Nov 29 13:22:02 user nova-compute[75071]: node.leading_login = No
Nov 29 13:22:02 user nova-compute[75071]: iface.iscsi_ifacename = default
Nov 29 13:22:02 user nova-compute[75071]: iface.net_ifacename = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.ipaddress = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.prefix_len = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.hwaddress = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.transport_name = tcp
Nov 29 13:22:02 user nova-compute[75071]: iface.initiatorname = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.state = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.vlan_id = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.vlan_priority = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.vlan_state = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.iface_num = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.mtu = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.port = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.bootproto = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.subnet_mask = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.gateway = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_alt_client_id = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_dns = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_learn_iqn = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_vendor_id_state = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_vendor_id = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.dhcp_slp_da = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.fragmentation = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.gratuitous_arp = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.incoming_forwarding = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.tos_state = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.tos = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.ttl = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.delayed_ack = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.tcp_nagle = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.tcp_wsf_state = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.tcp_wsf = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.tcp_timer_scale = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.tcp_timestamp = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.redirect = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.def_task_mgmt_timeout = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.header_digest = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.data_digest = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.immediate_data = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.initial_r2t = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.data_seq_inorder = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.data_pdu_inorder = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.erl = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.max_receive_data_len = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.first_burst_len = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.max_outstanding_r2t = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.max_burst_len = 0
Nov 29 13:22:02 user nova-compute[75071]: iface.chap_auth = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.bidi_chap = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.strict_login_compliance = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.discovery_auth = <empty>
Nov 29 13:22:02 user nova-compute[75071]: iface.discovery_logout = <empty>
Nov 29 13:22:02 user nova-compute[75071]: node.discovery_address = <empty>
Nov 29 13:22:02 user nova-compute[75071]: node.discovery_port = 0
Nov 29 13:22:02 user nova-compute[75071]: node.discovery_type = static
Nov 29 13:22:02 user nova-compute[75071]: node.session.initial_cmdsn = 0
Nov 29 13:22:02 user nova-compute[75071]: node.session.initial_login_retry_max = 8
Nov 29 13:22:02 user nova-compute[75071]: node.session.xmit_thread_priority = -20
Nov 29 13:22:02 user nova-compute[75071]: node.session.cmds_max = 128
Nov 29 13:22:02 user nova-compute[75071]: node.session.queue_depth = 32
Nov 29 13:22:02 user nova-compute[75071]: node.session.nr_sessions = 1
Nov 29 13:22:02 user nova-compute[75071]: node.session.auth.authmethod = CHAP
Nov 29 13:22:02 user nova-compute[75071]: node.session.auth.username = ajBQoicf
Nov 29 13:22:02 user nova-compute[75071]: node.session.auth.password = ***
Nov 29 13:22:02 user nova-compute[75071]: node.session.auth.username_in = <empty>
Nov 29 13:22:02 user nova-compute[75071]: node.session.auth.password_in = <empty>
Nov 29 13:22:02 user nova-compute[75071]: node.session.auth.chap_algs = MD5
Nov 29 13:22:02 user nova-compute[75071]: node.session.timeo.replacement_timeout = 120
Nov 29 13:22:02 user nova-compute[75071]: node.session.err_timeo.abort_timeout = 15
Nov 29 13:22:02 user nova-compute[75071]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 13:22:02 user nova-compute[75071]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 13:22:02 user nova-compute[75071]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.FastAbort = Yes
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.InitialR2T = No
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.ImmediateData = Yes
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.MaxConnections = 1
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 13:22:02 user nova-compute[75071]: node.session.iscsi.ERL = 0
Nov 29 13:22:02 user nova-compute[75071]: node.session.scan = manual
Nov 29 13:22:02 user nova-compute[75071]: node.session.reopen_max = 0
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].address = 172.16.0.220
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].port = 3260
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].startup = manual
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].tcp.window_size = 524288
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].tcp.type_of_service = 0
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].timeo.logout_timeout = 15
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].timeo.login_timeout = 15
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].timeo.auth_timeout = 45
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].iscsi.DataDigest = None
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].iscsi.IFMarker = No
Nov 29 13:22:02 user nova-compute[75071]: node.conn[0].iscsi.OFMarker = No
Nov 29 13:22:02 user nova-compute[75071]: # END RECORD
Nov 29 13:22:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f837cdfa-9851-467c-9c86-7f4d2dc19395) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d441f10-44c2-427e-9fc2-f62b5f5b61cf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: INFO os_vif [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7')
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:22:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b95a2d4-b16b-4052-8348-50f3c8e4917f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajBQoicf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing instance network info cache due to event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] Acquiring lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] Acquired lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajBQoicf" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d7bcd1-5479-416d-a1f5-e2250ed55f88]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajBQoicf'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef174d02-605d-49ad-a4ef-95d494f69d2e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5509fe3-b916-48bd-9647-c273b47d2114]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] HCTL ('35', '0', '0', 0) found on session 14 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[70924493-9d92-48bc-b973-141a0ae6c1cd]: (4, ('0 0 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Searching for a device in session 14 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajBQoicf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23364313134386563', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364313134386563', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.131s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e696505d-89e0-4533-b8aa-59511514be0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:22:03 user nova-compute[75071]: No targets found.
Nov 29 13:22:03 user nova-compute[75071]: iSNS:
Nov 29 13:22:03 user nova-compute[75071]: No targets found.
Nov 29 13:22:03 user nova-compute[75071]: STATIC:
Nov 29 13:22:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:22:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:22:03 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:22:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55
Nov 29 13:22:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:22:03 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:22:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:22:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:22:03 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:22:03 user nova-compute[75071]: FIRMWARE:
Nov 29 13:22:03 user nova-compute[75071]: No targets found.
Nov 29 13:22:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:22:03 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:22:03 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-984259261',display_name='tempest-ServerStableDeviceRescueTest-server-984259261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-984259261',id=4,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv956hhwxyofSbjnRV0xi2CXYQE5UqmKJmiBvc7uy5OHP1EnD8bvo08Zk4kcfLuw5dJBMKfe1b5SxaP7G0BrioQI7K2kAjL5OEBhKZIsjjhm9bfUXebdoLLCjwnfxHAow==',key_name='tempest-keypair-1727047100',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c77e1870fa1242049bc58bcdd5a91376',ramdisk_id='',reservation_id='r-az0rg775',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-798793767',owner_user_name='tempest-ServerStableDeviceRescueTest-798793767-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f196295464214feb8986122fa9fca139',uuid=ef8e7624-0193-4ba9-ae01-0a3a140f7a67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "vif_mac": "fa:16:3e:00:b2:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converting VIF {"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "vif_mac": "fa:16:3e:00:b2:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'pci_devices' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ec559f-027a-4fb2-8c81-ba607f1581da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.objects.base [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Object Instance<ef8e7624-0193-4ba9-ae01-0a3a140f7a67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:22:03 user nova-compute[75071]:   <uuid>ef8e7624-0193-4ba9-ae01-0a3a140f7a67</uuid>
Nov 29 13:22:03 user nova-compute[75071]:   <name>instance-00000004</name>
Nov 29 13:22:03 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:22:03 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:22:03 user nova-compute[75071]:   <metadata>
Nov 29 13:22:03 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:22:03 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:22:03 user nova-compute[75071]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-984259261</nova:name>
Nov 29 13:22:03 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:22:02</nova:creationTime>
Nov 29 13:22:03 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:22:03 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:22:03 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:22:03 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:22:03 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:22:03 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:22:03 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:22:03 user nova-compute[75071]:       <nova:owner>
Nov 29 13:22:03 user nova-compute[75071]:         <nova:user uuid="f196295464214feb8986122fa9fca139">tempest-ServerStableDeviceRescueTest-798793767-project-member</nova:user>
Nov 29 13:22:03 user nova-compute[75071]:         <nova:project uuid="c77e1870fa1242049bc58bcdd5a91376">tempest-ServerStableDeviceRescueTest-798793767</nova:project>
Nov 29 13:22:03 user nova-compute[75071]:       </nova:owner>
Nov 29 13:22:03 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:22:03 user nova-compute[75071]:       <nova:ports>
Nov 29 13:22:03 user nova-compute[75071]:         <nova:port uuid="16906a3e-623e-41b2-9940-0d068b2c5625">
Nov 29 13:22:03 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:22:03 user nova-compute[75071]:         </nova:port>
Nov 29 13:22:03 user nova-compute[75071]:       </nova:ports>
Nov 29 13:22:03 user nova-compute[75071]:     </nova:instance>
Nov 29 13:22:03 user nova-compute[75071]:   </metadata>
Nov 29 13:22:03 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:22:03 user nova-compute[75071]:     <system>
Nov 29 13:22:03 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:22:03 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:22:03 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:22:03 user nova-compute[75071]:       <entry name="serial">ef8e7624-0193-4ba9-ae01-0a3a140f7a67</entry>
Nov 29 13:22:03 user nova-compute[75071]:       <entry name="uuid">ef8e7624-0193-4ba9-ae01-0a3a140f7a67</entry>
Nov 29 13:22:03 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:22:03 user nova-compute[75071]:     </system>
Nov 29 13:22:03 user nova-compute[75071]:   </sysinfo>
Nov 29 13:22:03 user nova-compute[75071]:   <os>
Nov 29 13:22:03 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:22:03 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:22:03 user nova-compute[75071]:   </os>
Nov 29 13:22:03 user nova-compute[75071]:   <features>
Nov 29 13:22:03 user nova-compute[75071]:     <acpi/>
Nov 29 13:22:03 user nova-compute[75071]:     <apic/>
Nov 29 13:22:03 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:22:03 user nova-compute[75071]:   </features>
Nov 29 13:22:03 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:22:03 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:22:03 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:22:03 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:22:03 user nova-compute[75071]:   </clock>
Nov 29 13:22:03 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:22:03 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:22:03 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:22:03 user nova-compute[75071]:   </cpu>
Nov 29 13:22:03 user nova-compute[75071]:   <devices>
Nov 29 13:22:03 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:22:03 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:22:03 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk"/>
Nov 29 13:22:03 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:22:03 user nova-compute[75071]:     </disk>
Nov 29 13:22:03 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:22:03 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:22:03 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Nov 29 13:22:03 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:22:03 user nova-compute[75071]:       <serial>52ea8ca0-7566-45a8-bcbe-b944f1fd6689</serial>
Nov 29 13:22:03 user nova-compute[75071]:     </disk>
Nov 29 13:22:03 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:22:03 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:22:03 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue"/>
Nov 29 13:22:03 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Nov 29 13:22:03 user nova-compute[75071]:       <boot order="1"/>
Nov 29 13:22:03 user nova-compute[75071]:     </disk>
Nov 29 13:22:03 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:22:03 user nova-compute[75071]:       <mac address="fa:16:3e:00:b2:03"/>
Nov 29 13:22:03 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:03 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:22:03 user nova-compute[75071]:       <target dev="tap16906a3e-62"/>
Nov 29 13:22:03 user nova-compute[75071]:     </interface>
Nov 29 13:22:03 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:22:03 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/console.log" append="off"/>
Nov 29 13:22:03 user nova-compute[75071]:     </serial>
Nov 29 13:22:03 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:22:03 user nova-compute[75071]:     <video>
Nov 29 13:22:03 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:03 user nova-compute[75071]:     </video>
Nov 29 13:22:03 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:22:03 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:22:03 user nova-compute[75071]:     </rng>
Nov 29 13:22:03 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:22:03 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:22:03 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:22:03 user nova-compute[75071]:     </memballoon>
Nov 29 13:22:03 user nova-compute[75071]:   </devices>
Nov 29 13:22:03 user nova-compute[75071]: </domain>
Nov 29 13:22:03 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:22:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance destroyed successfully.
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14973ef-10b9-4f34-a4ab-7f8fe01e0eee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:22:03 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f216c5f7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[523e7348-d754-48c8-aa8e-9e0ba9ed5326]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93c4a58-47ab-4aa8-bced-b4bbb5979cc6]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad9ecd-adc3-4e5d-8928-8d3feb4a2eab]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] No VIF found with MAC fa:16:3e:00:b2:03, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58d9e1a-48bb-4ef6-843b-fc435a7eddfd]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d066ff5-eddb-49ed-bcf9-c0e69a7fe38a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2030ad7e-87ae-415f-8d3b-a0e5efe98c88]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]
Nov 29 13:22:03 user nova-compute[75071]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.
Nov 29 13:22:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d4e252-610d-42c1-9d97-b5eb82b52d64]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== disconnect_volume: return (468ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updated VIF entry in instance network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e24a0594-b1e2-4e46-8f61-f98ec4e5b613 req-8f4fc93f-13a9-436a-b5b0-6c1ff860a442 service nova] Releasing lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:22:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1_resize/disk /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "cp -r /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1_resize/disk /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk" returned: 0 in 0.473s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1_resize/disk.info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk.info {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "cp -r /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1_resize/disk.info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk.info" returned: 0 in 0.033s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-9a57c3a3-82df-49f8-b16e-369b758433de req-09a1f366-8e91-4e36-802d-93894b01cd85 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9a57c3a3-82df-49f8-b16e-369b758433de req-09a1f366-8e91-4e36-802d-93894b01cd85 service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9a57c3a3-82df-49f8-b16e-369b758433de req-09a1f366-8e91-4e36-802d-93894b01cd85 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9a57c3a3-82df-49f8-b16e-369b758433de req-09a1f366-8e91-4e36-802d-93894b01cd85 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-9a57c3a3-82df-49f8-b16e-369b758433de req-09a1f366-8e91-4e36-802d-93894b01cd85 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:04 user nova-compute[75071]: WARNING nova.compute.manager [req-9a57c3a3-82df-49f8-b16e-369b758433de req-09a1f366-8e91-4e36-802d-93894b01cd85 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state active and task_state resize_migrating.
Nov 29 13:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing instance network info cache due to event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] Acquiring lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] Acquired lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updated VIF entry in instance network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Port 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd binding to destination host user is already ACTIVE {{(pid=75071) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] Releasing lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:05 user nova-compute[75071]: WARNING nova.compute.manager [req-fec394dd-08f4-4526-8b6d-6ba2503c718f req-0d3b21a3-f6d8-4ecb-a5e2-467ef12aa2fa service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state active and task_state rescuing.
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG os_brick.utils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[548fc2e9-c587-49c9-a986-4c8f23301426]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7cd3ca-9bf6-46f5-88ae-e1cdca226702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f893ed6-c952-4c4a-84f8-073a905089d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afcc0e3-c975-4e0a-80ca-5f0ceccab9ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:22:06 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241426e-3454-4337-9cef-b7cf941d04b0]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:22:06 user nova-compute[75071]: DEBUG os_brick.utils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:22:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-127c0cb3-cc6c-4c2e-85c4-6990be641a80 req-25eb8065-1449-4dda-9fa6-ecc15a9b181b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-127c0cb3-cc6c-4c2e-85c4-6990be641a80 req-25eb8065-1449-4dda-9fa6-ecc15a9b181b service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-127c0cb3-cc6c-4c2e-85c4-6990be641a80 req-25eb8065-1449-4dda-9fa6-ecc15a9b181b service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-127c0cb3-cc6c-4c2e-85c4-6990be641a80 req-25eb8065-1449-4dda-9fa6-ecc15a9b181b service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-127c0cb3-cc6c-4c2e-85c4-6990be641a80 req-25eb8065-1449-4dda-9fa6-ecc15a9b181b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:07 user nova-compute[75071]: WARNING nova.compute.manager [req-127c0cb3-cc6c-4c2e-85c4-6990be641a80 req-25eb8065-1449-4dda-9fa6-ecc15a9b181b service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state active and task_state rescuing.
Nov 29 13:22:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a77ca353-e749-4724-a18a-570e6d07178f tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:22:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:09 user nova-compute[75071]: INFO nova.compute.manager [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Rebooting instance
Nov 29 13:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquired lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Releasing lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb8f8143-c43d-4f80-82ba-96da907d2493 req-811a840d-c1e4-4697-b19f-6cf6b89fb51d service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-unplugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb8f8143-c43d-4f80-82ba-96da907d2493 req-811a840d-c1e4-4697-b19f-6cf6b89fb51d service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb8f8143-c43d-4f80-82ba-96da907d2493 req-811a840d-c1e4-4697-b19f-6cf6b89fb51d service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb8f8143-c43d-4f80-82ba-96da907d2493 req-811a840d-c1e4-4697-b19f-6cf6b89fb51d service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb8f8143-c43d-4f80-82ba-96da907d2493 req-811a840d-c1e4-4697-b19f-6cf6b89fb51d service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-unplugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:11 user nova-compute[75071]: WARNING nova.compute.manager [req-fb8f8143-c43d-4f80-82ba-96da907d2493 req-811a840d-c1e4-4697-b19f-6cf6b89fb51d service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received unexpected event network-vif-unplugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 13:22:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance destroyed successfully.
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'resources' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696092294',display_name='tempest-TestMinimumBasicScenario-server-1696092294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696092294',id=12,image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OU7wq777KNWtgTh49zMjolfl5F1CAP90X7BiOt3SVRTfAL0/XiizPFpYgWG55eFSvJkVxqUafEM3VDJwguK4WlVeppff2vZX9SAzGFHKsBnuuhLuRfBpx/2LcaRwUGQ==',key_name='tempest-TestMinimumBasicScenario-664367511',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-gx0s410n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:22:11Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=f7c9047c-00f3-4cb3-9290-6d118bda1c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_vif [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc66d61b-df, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51a6743d-ba5b-4396-b319-f95d716cfec5) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:11 user nova-compute[75071]: INFO os_vif [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df')
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNyqeDUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:22:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[285799a5-7ce0-41d4-a8c9-63100f24bca5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:22:11 user nova-compute[75071]: No targets found.
Nov 29 13:22:11 user nova-compute[75071]: iSNS:
Nov 29 13:22:11 user nova-compute[75071]: No targets found.
Nov 29 13:22:11 user nova-compute[75071]: STATIC:
Nov 29 13:22:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55
Nov 29 13:22:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:22:11 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:22:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:22:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:22:11 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:22:11 user nova-compute[75071]: FIRMWARE:
Nov 29 13:22:11 user nova-compute[75071]: No targets found.
Nov 29 13:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:22:11 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:22:11 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[24778f65-5754-46ef-8529-53cddc77bf53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb09602-1c60-44cb-a71d-6e5a11ecbd50]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:11 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:11 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e1b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb3104-acf8-4de1-8b1d-e877fa827e60]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2162065d-ca64-4c72-bdbf-44fa4ba8fd3e]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4ea2f-bec1-4803-a94a-09df37337a38]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bce780d-a862-4fcb-967b-7a3195801fc3]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2cd62e-6c0f-4016-ab70-5fa1d2caff1b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44dfbc3-dd18-4dc9-9491-ed69342f3535]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]
Nov 29 13:22:11 user nova-compute[75071]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.
Nov 29 13:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f4f6e0-0802-4f48-bbd7-0f1ead261b37]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== disconnect_volume: return (296ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Start _get_guest_xml network_info=[{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1d86e741-7224-4df1-9d02-dd4ede829179,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1d86e741-7224-4df1-9d02-dd4ede829179'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNyqeDUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f7c9047c-00f3-4cb3-9290-6d118bda1c9c', 'attached_at': '', 'detached_at': '', 'volume_id': '883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'serial': '883dbcb6-4f9d-4469-ab00-47c241d1ef55'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '5ac7c88e-4c72-43b4-be88-3c94e2ac39d4', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:22:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1d86e741-7224-4df1-9d02-dd4ede829179,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.objects.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Object Instance<f7c9047c-00f3-4cb3-9290-6d118bda1c9c> lazy-loaded attributes: resources,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNyqeDUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:22:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:11 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf019f-419b-454c-8d1c-84a019ffb524]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:22:11 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc8ca9-a812-4429-a279-966fd0d8d4dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55] added
Nov 29 13:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1738fdb-5e75-47c6-a125-43b845bd5941]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5802ee26-3e0e-464e-8f75-1e5e601cc8c2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNyqeDUW {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNyqeDUW" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[452c764e-ef84-4b91-845a-d20b4fedfe8f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNyqeDUW'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[912612f1-f079-4fab-ab76-057f4c693740]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a937e-40b6-4036-924b-07412967e0ed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a168dd7-9bc2-4afc-a1f0-efa5bae2e6e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]
Nov 29 13:22:12 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.
Nov 29 13:22:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a145d4-d063-4c75-a73b-9abf81cd2d3d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b60c7f5-da1d-4dc8-98ff-e987fb8eb4cc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:12 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:12 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d103d6d-af7b-456c-ba65-fff40c888a51]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:22:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNyqeDUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-51dddb74-784e-408a-998c-43ab5654e7d7 req-c7add648-80d9-49ef-a48a-c348149c5a9b service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51dddb74-784e-408a-998c-43ab5654e7d7 req-c7add648-80d9-49ef-a48a-c348149c5a9b service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51dddb74-784e-408a-998c-43ab5654e7d7 req-c7add648-80d9-49ef-a48a-c348149c5a9b service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51dddb74-784e-408a-998c-43ab5654e7d7 req-c7add648-80d9-49ef-a48a-c348149c5a9b service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-51dddb74-784e-408a-998c-43ab5654e7d7 req-c7add648-80d9-49ef-a48a-c348149c5a9b service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:13 user nova-compute[75071]: WARNING nova.compute.manager [req-51dddb74-784e-408a-998c-43ab5654e7d7 req-c7add648-80d9-49ef-a48a-c348149c5a9b service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received unexpected event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 13:22:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26131663036306662', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131663036306662', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696092294',display_name='tempest-TestMinimumBasicScenario-server-1696092294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696092294',id=12,image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OU7wq777KNWtgTh49zMjolfl5F1CAP90X7BiOt3SVRTfAL0/XiizPFpYgWG55eFSvJkVxqUafEM3VDJwguK4WlVeppff2vZX9SAzGFHKsBnuuhLuRfBpx/2LcaRwUGQ==',key_name='tempest-TestMinimumBasicScenario-664367511',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-gx0s410n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:22:11Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=f7c9047c-00f3-4cb3-9290-6d118bda1c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'pci_devices' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.objects.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Object Instance<f7c9047c-00f3-4cb3-9290-6d118bda1c9c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:22:13 user nova-compute[75071]:   <uuid>f7c9047c-00f3-4cb3-9290-6d118bda1c9c</uuid>
Nov 29 13:22:13 user nova-compute[75071]:   <name>instance-0000000c</name>
Nov 29 13:22:13 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:22:13 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:22:13 user nova-compute[75071]:   <metadata>
Nov 29 13:22:13 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:22:13 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:22:13 user nova-compute[75071]:       <nova:name>tempest-TestMinimumBasicScenario-server-1696092294</nova:name>
Nov 29 13:22:13 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:22:11</nova:creationTime>
Nov 29 13:22:13 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:22:13 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:22:13 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:22:13 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:22:13 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:22:13 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:22:13 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:22:13 user nova-compute[75071]:       <nova:owner>
Nov 29 13:22:13 user nova-compute[75071]:         <nova:user uuid="0d54f49fa05c4317bb667c1877cb466a">tempest-TestMinimumBasicScenario-182325840-project-member</nova:user>
Nov 29 13:22:13 user nova-compute[75071]:         <nova:project uuid="50f58750d5b84ed9847af078c31c0004">tempest-TestMinimumBasicScenario-182325840</nova:project>
Nov 29 13:22:13 user nova-compute[75071]:       </nova:owner>
Nov 29 13:22:13 user nova-compute[75071]:       <nova:root type="image" uuid="1d86e741-7224-4df1-9d02-dd4ede829179"/>
Nov 29 13:22:13 user nova-compute[75071]:       <nova:ports>
Nov 29 13:22:13 user nova-compute[75071]:         <nova:port uuid="fc66d61b-df87-483c-96a1-89033c9deaa8">
Nov 29 13:22:13 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:22:13 user nova-compute[75071]:         </nova:port>
Nov 29 13:22:13 user nova-compute[75071]:       </nova:ports>
Nov 29 13:22:13 user nova-compute[75071]:     </nova:instance>
Nov 29 13:22:13 user nova-compute[75071]:   </metadata>
Nov 29 13:22:13 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:22:13 user nova-compute[75071]:     <system>
Nov 29 13:22:13 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:22:13 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:22:13 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:22:13 user nova-compute[75071]:       <entry name="serial">f7c9047c-00f3-4cb3-9290-6d118bda1c9c</entry>
Nov 29 13:22:13 user nova-compute[75071]:       <entry name="uuid">f7c9047c-00f3-4cb3-9290-6d118bda1c9c</entry>
Nov 29 13:22:13 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:22:13 user nova-compute[75071]:     </system>
Nov 29 13:22:13 user nova-compute[75071]:   </sysinfo>
Nov 29 13:22:13 user nova-compute[75071]:   <os>
Nov 29 13:22:13 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:22:13 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:22:13 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:22:13 user nova-compute[75071]:   </os>
Nov 29 13:22:13 user nova-compute[75071]:   <features>
Nov 29 13:22:13 user nova-compute[75071]:     <acpi/>
Nov 29 13:22:13 user nova-compute[75071]:     <apic/>
Nov 29 13:22:13 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:22:13 user nova-compute[75071]:   </features>
Nov 29 13:22:13 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:22:13 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:22:13 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:22:13 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:22:13 user nova-compute[75071]:   </clock>
Nov 29 13:22:13 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:22:13 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:22:13 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:22:13 user nova-compute[75071]:   </cpu>
Nov 29 13:22:13 user nova-compute[75071]:   <devices>
Nov 29 13:22:13 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:22:13 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:22:13 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk"/>
Nov 29 13:22:13 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:22:13 user nova-compute[75071]:     </disk>
Nov 29 13:22:13 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:22:13 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:22:13 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Nov 29 13:22:13 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:22:13 user nova-compute[75071]:       <serial>883dbcb6-4f9d-4469-ab00-47c241d1ef55</serial>
Nov 29 13:22:13 user nova-compute[75071]:     </disk>
Nov 29 13:22:13 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:22:13 user nova-compute[75071]:       <mac address="fa:16:3e:90:2e:ad"/>
Nov 29 13:22:13 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:13 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:22:13 user nova-compute[75071]:       <target dev="tapfc66d61b-df"/>
Nov 29 13:22:13 user nova-compute[75071]:     </interface>
Nov 29 13:22:13 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:22:13 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/console.log" append="off"/>
Nov 29 13:22:13 user nova-compute[75071]:     </serial>
Nov 29 13:22:13 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:22:13 user nova-compute[75071]:     <video>
Nov 29 13:22:13 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:13 user nova-compute[75071]:     </video>
Nov 29 13:22:13 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:22:13 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:22:13 user nova-compute[75071]:     </rng>
Nov 29 13:22:13 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:22:13 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:22:13 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:22:13 user nova-compute[75071]:     </memballoon>
Nov 29 13:22:13 user nova-compute[75071]:   </devices>
Nov 29 13:22:13 user nova-compute[75071]: </domain>
Nov 29 13:22:13 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'trusted_certs' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.objects.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Object Instance<f7c9047c-00f3-4cb3-9290-6d118bda1c9c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Cannot resize image /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'migration_context' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG nova.objects.base [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Object Instance<f7c9047c-00f3-4cb3-9290-6d118bda1c9c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696092294',display_name='tempest-TestMinimumBasicScenario-server-1696092294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696092294',id=12,image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OU7wq777KNWtgTh49zMjolfl5F1CAP90X7BiOt3SVRTfAL0/XiizPFpYgWG55eFSvJkVxqUafEM3VDJwguK4WlVeppff2vZX9SAzGFHKsBnuuhLuRfBpx/2LcaRwUGQ==',key_name='tempest-TestMinimumBasicScenario-664367511',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-gx0s410n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:11Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=f7c9047c-00f3-4cb3-9290-6d118bda1c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG os_vif [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99dbfdea-a429-5643-8d2b-d702e94cea1f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc66d61b-df, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc66d61b-df, col_values=(('qos', UUID('048eb8dd-eeb2-4ad7-9e3e-e273e097b6b6')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc66d61b-df, col_values=(('external_ids', {'iface-id': 'fc66d61b-df87-483c-96a1-89033c9deaa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:2e:ad', 'vm-uuid': 'f7c9047c-00f3-4cb3-9290-6d118bda1c9c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:14 user nova-compute[75071]: INFO os_vif [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df')
Nov 29 13:22:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Starting finish_migration {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:22:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Creating image(s)
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk. size=21474836480 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk 21474836480 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk 21474836480" returned: 0 in 0.235s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Ensure instance console log exists: /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Start _get_guest_xml network_info=[{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1449639590-network", "vif_mac": "fa:16:3e:92:79:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6935d835-c98f-4355-8031-4436125925f1', 'attached_at': '2023-11-29T13:22:15.000000', 'detached_at': '', 'volume_id': '789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'serial': '789d9c7e-beb3-4dd9-9a2d-f47aaf07474a'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '1b7e9cd5-e613-4db4-8d27-a6fe52648d75', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:22:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:22:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:22:15 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e02be5-1a3b-4995-b722-26ba5ef14c68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:22:15 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0586e1-30f4-4155-a17a-2c9005f38a37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a] added
Nov 29 13:22:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[21340eab-fd6d-4cb0-811f-701dfac6ce9a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.075s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[481ad998-cb82-4cb6-8782-99f93488d54b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYSqnbVO {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-e24063d7-3302-45fb-ae7c-01379b79b372 req-cdfbae45-1d81-4f75-990a-7eb68d041600 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e24063d7-3302-45fb-ae7c-01379b79b372 req-cdfbae45-1d81-4f75-990a-7eb68d041600 service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e24063d7-3302-45fb-ae7c-01379b79b372 req-cdfbae45-1d81-4f75-990a-7eb68d041600 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e24063d7-3302-45fb-ae7c-01379b79b372 req-cdfbae45-1d81-4f75-990a-7eb68d041600 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-e24063d7-3302-45fb-ae7c-01379b79b372 req-cdfbae45-1d81-4f75-990a-7eb68d041600 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:16 user nova-compute[75071]: WARNING nova.compute.manager [req-e24063d7-3302-45fb-ae7c-01379b79b372 req-cdfbae45-1d81-4f75-990a-7eb68d041600 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received unexpected event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYSqnbVO" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e19258-45c4-4413-b611-6bb563df4038]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZYSqnbVO'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.094s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b3cb8-979d-42e5-beae-554bbc21affa]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da62e66-5ad2-4681-b6fd-e5f7e39fbb4f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6905e72-d04d-4b42-bddc-979269cb5fc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]
Nov 29 13:22:16 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.
Nov 29 13:22:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c301c-14f1-42bc-9bbf-448c14efd43c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[18424ac8-a779-40f2-a345-eb9487fa7064]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:22:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:22:16 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:22:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.505s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec96eca-82b1-4ff0-8857-0ba7cd5a217d]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:22:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '26464613365623430', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464613365623430', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1449639590-network", "vif_mac": "fa:16:3e:92:79:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1449639590-network", "vif_mac": "fa:16:3e:92:79:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:22:17 user nova-compute[75071]:   <uuid>6935d835-c98f-4355-8031-4436125925f1</uuid>
Nov 29 13:22:17 user nova-compute[75071]:   <name>instance-00000003</name>
Nov 29 13:22:17 user nova-compute[75071]:   <memory>2097152</memory>
Nov 29 13:22:17 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:22:17 user nova-compute[75071]:   <metadata>
Nov 29 13:22:17 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:22:17 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:22:17 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherB-server-2016764760</nova:name>
Nov 29 13:22:17 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:22:15</nova:creationTime>
Nov 29 13:22:17 user nova-compute[75071]:       <nova:flavor name="m1.small">
Nov 29 13:22:17 user nova-compute[75071]:         <nova:memory>2048</nova:memory>
Nov 29 13:22:17 user nova-compute[75071]:         <nova:disk>20</nova:disk>
Nov 29 13:22:17 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:22:17 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:22:17 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:22:17 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:22:17 user nova-compute[75071]:       <nova:owner>
Nov 29 13:22:17 user nova-compute[75071]:         <nova:user uuid="41649c13883b4d01a13a22c529f9bc6f">tempest-ServerActionsTestOtherB-1138605091-project-member</nova:user>
Nov 29 13:22:17 user nova-compute[75071]:         <nova:project uuid="42978586ae934e319e9848de833d9877">tempest-ServerActionsTestOtherB-1138605091</nova:project>
Nov 29 13:22:17 user nova-compute[75071]:       </nova:owner>
Nov 29 13:22:17 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:22:17 user nova-compute[75071]:       <nova:ports>
Nov 29 13:22:17 user nova-compute[75071]:         <nova:port uuid="10d0cfed-e70a-4d6e-b80c-75e2376fc0cd">
Nov 29 13:22:17 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:22:17 user nova-compute[75071]:         </nova:port>
Nov 29 13:22:17 user nova-compute[75071]:       </nova:ports>
Nov 29 13:22:17 user nova-compute[75071]:     </nova:instance>
Nov 29 13:22:17 user nova-compute[75071]:   </metadata>
Nov 29 13:22:17 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:22:17 user nova-compute[75071]:     <system>
Nov 29 13:22:17 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:22:17 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:22:17 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:22:17 user nova-compute[75071]:       <entry name="serial">6935d835-c98f-4355-8031-4436125925f1</entry>
Nov 29 13:22:17 user nova-compute[75071]:       <entry name="uuid">6935d835-c98f-4355-8031-4436125925f1</entry>
Nov 29 13:22:17 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:22:17 user nova-compute[75071]:     </system>
Nov 29 13:22:17 user nova-compute[75071]:   </sysinfo>
Nov 29 13:22:17 user nova-compute[75071]:   <os>
Nov 29 13:22:17 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:22:17 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:22:17 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:22:17 user nova-compute[75071]:   </os>
Nov 29 13:22:17 user nova-compute[75071]:   <features>
Nov 29 13:22:17 user nova-compute[75071]:     <acpi/>
Nov 29 13:22:17 user nova-compute[75071]:     <apic/>
Nov 29 13:22:17 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:22:17 user nova-compute[75071]:   </features>
Nov 29 13:22:17 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:22:17 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:22:17 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:22:17 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:22:17 user nova-compute[75071]:   </clock>
Nov 29 13:22:17 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:22:17 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:22:17 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:22:17 user nova-compute[75071]:   </cpu>
Nov 29 13:22:17 user nova-compute[75071]:   <devices>
Nov 29 13:22:17 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:22:17 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:22:17 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk"/>
Nov 29 13:22:17 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:22:17 user nova-compute[75071]:     </disk>
Nov 29 13:22:17 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:22:17 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:22:17 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Nov 29 13:22:17 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:22:17 user nova-compute[75071]:       <serial>789d9c7e-beb3-4dd9-9a2d-f47aaf07474a</serial>
Nov 29 13:22:17 user nova-compute[75071]:     </disk>
Nov 29 13:22:17 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:22:17 user nova-compute[75071]:       <mac address="fa:16:3e:92:79:29"/>
Nov 29 13:22:17 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:17 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:22:17 user nova-compute[75071]:       <target dev="tap10d0cfed-e7"/>
Nov 29 13:22:17 user nova-compute[75071]:     </interface>
Nov 29 13:22:17 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:22:17 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/console.log" append="off"/>
Nov 29 13:22:17 user nova-compute[75071]:     </serial>
Nov 29 13:22:17 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:22:17 user nova-compute[75071]:     <video>
Nov 29 13:22:17 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:17 user nova-compute[75071]:     </video>
Nov 29 13:22:17 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:22:17 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:22:17 user nova-compute[75071]:     </rng>
Nov 29 13:22:17 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:22:17 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:22:17 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:22:17 user nova-compute[75071]:     </memballoon>
Nov 29 13:22:17 user nova-compute[75071]:   </devices>
Nov 29 13:22:17 user nova-compute[75071]: </domain>
Nov 29 13:22:17 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1449639590-network", "vif_mac": "fa:16:3e:92:79:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1449639590-network", "vif_mac": "fa:16:3e:92:79:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG os_vif [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f77593a-61a7-51c1-bca4-88476bae037b', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10d0cfed-e7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10d0cfed-e7, col_values=(('qos', UUID('6d0184b5-8c39-4f31-987a-d6e30b54a27f')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10d0cfed-e7, col_values=(('external_ids', {'iface-id': '10d0cfed-e70a-4d6e-b80c-75e2376fc0cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:79:29', 'vm-uuid': '6935d835-c98f-4355-8031-4436125925f1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:17 user nova-compute[75071]: INFO os_vif [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7')
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] No VIF found with MAC fa:16:3e:92:79:29, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:22:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance rebooted successfully.
Nov 29 13:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2eff84d3-6561-49b7-bbe8-73f42bdef51d tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.118s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-c79fcb95-d465-47ff-86c8-9c62255fca6a req-96ee9ad9-5456-438a-bfe9-8395753bd3a9 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c79fcb95-d465-47ff-86c8-9c62255fca6a req-96ee9ad9-5456-438a-bfe9-8395753bd3a9 service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c79fcb95-d465-47ff-86c8-9c62255fca6a req-96ee9ad9-5456-438a-bfe9-8395753bd3a9 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c79fcb95-d465-47ff-86c8-9c62255fca6a req-96ee9ad9-5456-438a-bfe9-8395753bd3a9 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-c79fcb95-d465-47ff-86c8-9c62255fca6a req-96ee9ad9-5456-438a-bfe9-8395753bd3a9 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:18 user nova-compute[75071]: WARNING nova.compute.manager [req-c79fcb95-d465-47ff-86c8-9c62255fca6a req-96ee9ad9-5456-438a-bfe9-8395753bd3a9 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received unexpected event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with vm_state active and task_state None.
Nov 29 13:22:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:20 user nova-compute[75071]: WARNING nova.compute.manager [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state active and task_state resize_finish.
Nov 29 13:22:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:20 user nova-compute[75071]: WARNING nova.compute.manager [req-71e32883-a74e-4c6a-a878-45ec6366e7a5 req-7691528d-9207-4592-8ca5-948eb0156a63 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state active and task_state resize_finish.
Nov 29 13:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:22:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance running successfully.
Nov 29 13:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Failed to set time: agent not configured {{(pid=75071) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 13:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f4747c-d2c3-4d29-8327-5fa53940adeb tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] finish_migration finished successfully. {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 13:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:22:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:22:31 user nova-compute[75071]: INFO nova.compute.claims [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Claim successful on node user
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:22:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.policy [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '350e0cf65eeb441582c203ac06668009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f00a9cd6fd4b4398314100706a720b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:22:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Creating image(s)
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk 1073741824" returned: 0 in 0.061s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Successfully created port: 6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Cannot resize image /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Ensure instance console log exists: /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Successfully updated port: 6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquired lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-changed-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Refreshing instance network info cache due to event network-changed-6049ab99-d0e5-4db3-85e3-927718b9092e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] Acquiring lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updating instance_info_cache with network_info: [{"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Releasing lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Instance network_info: |[{"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] Acquired lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Refreshing network info cache for port 6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Start _get_guest_xml network_info=[{"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:22:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-617762259',display_name='tempest-AttachVolumeNegativeTest-server-617762259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-617762259',id=15,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg/24yq2PdKwTK7pXat8VN8Xord8EXc1BUB3MUHbwlcRI0y3aIlLNnAYVtkCEPLkvZI1DXszOR/5dyeODZcDGYycIa9uHL6VNXZs6TJCK7qI7P2/a3pLbAaqL8wYJT7pg==',key_name='tempest-keypair-428284518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-kql42uam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=a1c074cd-4c13-4dc5-80fe-c05c637d3ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=6049ab99-d0e5-4db3-85e3-927718b9092e,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6049ab99-d0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'pci_devices' on Instance uuid a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:22:34 user nova-compute[75071]:   <uuid>a1c074cd-4c13-4dc5-80fe-c05c637d3ac8</uuid>
Nov 29 13:22:34 user nova-compute[75071]:   <name>instance-0000000f</name>
Nov 29 13:22:34 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:22:34 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:22:34 user nova-compute[75071]:   <metadata>
Nov 29 13:22:34 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:22:34 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:22:34 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-617762259</nova:name>
Nov 29 13:22:34 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:22:34</nova:creationTime>
Nov 29 13:22:34 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:22:34 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:22:34 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:22:34 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:22:34 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:22:34 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:22:34 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:22:34 user nova-compute[75071]:       <nova:owner>
Nov 29 13:22:34 user nova-compute[75071]:         <nova:user uuid="350e0cf65eeb441582c203ac06668009">tempest-AttachVolumeNegativeTest-1996696047-project-member</nova:user>
Nov 29 13:22:34 user nova-compute[75071]:         <nova:project uuid="f9f00a9cd6fd4b4398314100706a720b">tempest-AttachVolumeNegativeTest-1996696047</nova:project>
Nov 29 13:22:34 user nova-compute[75071]:       </nova:owner>
Nov 29 13:22:34 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:22:34 user nova-compute[75071]:       <nova:ports>
Nov 29 13:22:34 user nova-compute[75071]:         <nova:port uuid="6049ab99-d0e5-4db3-85e3-927718b9092e">
Nov 29 13:22:34 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:22:34 user nova-compute[75071]:         </nova:port>
Nov 29 13:22:34 user nova-compute[75071]:       </nova:ports>
Nov 29 13:22:34 user nova-compute[75071]:     </nova:instance>
Nov 29 13:22:34 user nova-compute[75071]:   </metadata>
Nov 29 13:22:34 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:22:34 user nova-compute[75071]:     <system>
Nov 29 13:22:34 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:22:34 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:22:34 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:22:34 user nova-compute[75071]:       <entry name="serial">a1c074cd-4c13-4dc5-80fe-c05c637d3ac8</entry>
Nov 29 13:22:34 user nova-compute[75071]:       <entry name="uuid">a1c074cd-4c13-4dc5-80fe-c05c637d3ac8</entry>
Nov 29 13:22:34 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:22:34 user nova-compute[75071]:     </system>
Nov 29 13:22:34 user nova-compute[75071]:   </sysinfo>
Nov 29 13:22:34 user nova-compute[75071]:   <os>
Nov 29 13:22:34 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:22:34 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:22:34 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:22:34 user nova-compute[75071]:   </os>
Nov 29 13:22:34 user nova-compute[75071]:   <features>
Nov 29 13:22:34 user nova-compute[75071]:     <acpi/>
Nov 29 13:22:34 user nova-compute[75071]:     <apic/>
Nov 29 13:22:34 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:22:34 user nova-compute[75071]:   </features>
Nov 29 13:22:34 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:22:34 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:22:34 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:22:34 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:22:34 user nova-compute[75071]:   </clock>
Nov 29 13:22:34 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:22:34 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:22:34 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:22:34 user nova-compute[75071]:   </cpu>
Nov 29 13:22:34 user nova-compute[75071]:   <devices>
Nov 29 13:22:34 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:22:34 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:22:34 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk"/>
Nov 29 13:22:34 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:22:34 user nova-compute[75071]:     </disk>
Nov 29 13:22:34 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:22:34 user nova-compute[75071]:       <mac address="fa:16:3e:c4:bc:e0"/>
Nov 29 13:22:34 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:34 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:22:34 user nova-compute[75071]:       <target dev="tap6049ab99-d0"/>
Nov 29 13:22:34 user nova-compute[75071]:     </interface>
Nov 29 13:22:34 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:22:34 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/console.log" append="off"/>
Nov 29 13:22:34 user nova-compute[75071]:     </serial>
Nov 29 13:22:34 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:22:34 user nova-compute[75071]:     <video>
Nov 29 13:22:34 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:34 user nova-compute[75071]:     </video>
Nov 29 13:22:34 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:22:34 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:22:34 user nova-compute[75071]:     </rng>
Nov 29 13:22:34 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:22:34 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:22:34 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:22:34 user nova-compute[75071]:     </memballoon>
Nov 29 13:22:34 user nova-compute[75071]:   </devices>
Nov 29 13:22:34 user nova-compute[75071]: </domain>
Nov 29 13:22:34 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-617762259',display_name='tempest-AttachVolumeNegativeTest-server-617762259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-617762259',id=15,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg/24yq2PdKwTK7pXat8VN8Xord8EXc1BUB3MUHbwlcRI0y3aIlLNnAYVtkCEPLkvZI1DXszOR/5dyeODZcDGYycIa9uHL6VNXZs6TJCK7qI7P2/a3pLbAaqL8wYJT7pg==',key_name='tempest-keypair-428284518',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-kql42uam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=a1c074cd-4c13-4dc5-80fe-c05c637d3ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=6049ab99-d0e5-4db3-85e3-927718b9092e,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6049ab99-d0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG os_vif [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=6049ab99-d0e5-4db3-85e3-927718b9092e,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6049ab99-d0') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfe44e8e-bdd4-538b-b3c9-5faf2f6510f4', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6049ab99-d0, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6049ab99-d0, col_values=(('qos', UUID('3849e479-2334-435f-a7f7-2b845244d44f')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6049ab99-d0, col_values=(('external_ids', {'iface-id': '6049ab99-d0e5-4db3-85e3-927718b9092e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:bc:e0', 'vm-uuid': 'a1c074cd-4c13-4dc5-80fe-c05c637d3ac8'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:34 user nova-compute[75071]: INFO os_vif [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=6049ab99-d0e5-4db3-85e3-927718b9092e,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6049ab99-d0')
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No VIF found with MAC fa:16:3e:c4:bc:e0, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updated VIF entry in instance network info cache for port 6049ab99-d0e5-4db3-85e3-927718b9092e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updating instance_info_cache with network_info: [{"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-06537922-264a-4e73-a028-d376babb4eff req-a675f4d6-dcb0-4065-a0e5-0254c0570312 service nova] Releasing lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-6012c724-54d9-4552-85a6-ff6d19cbeee6 req-2e0a4697-3e8b-42e6-8312-0bafff69cf83 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6012c724-54d9-4552-85a6-ff6d19cbeee6 req-2e0a4697-3e8b-42e6-8312-0bafff69cf83 service nova] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6012c724-54d9-4552-85a6-ff6d19cbeee6 req-2e0a4697-3e8b-42e6-8312-0bafff69cf83 service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6012c724-54d9-4552-85a6-ff6d19cbeee6 req-2e0a4697-3e8b-42e6-8312-0bafff69cf83 service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-6012c724-54d9-4552-85a6-ff6d19cbeee6 req-2e0a4697-3e8b-42e6-8312-0bafff69cf83 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] No waiting events found dispatching network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:36 user nova-compute[75071]: WARNING nova.compute.manager [req-6012c724-54d9-4552-85a6-ff6d19cbeee6 req-2e0a4697-3e8b-42e6-8312-0bafff69cf83 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received unexpected event network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e for instance with vm_state building and task_state spawning.
Nov 29 13:22:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1a7e47c-7436-470e-aeaf-ded0a3242d97 req-3c2b098b-51b0-4207-a5d0-88a0a07f785f service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1a7e47c-7436-470e-aeaf-ded0a3242d97 req-3c2b098b-51b0-4207-a5d0-88a0a07f785f service nova] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1a7e47c-7436-470e-aeaf-ded0a3242d97 req-3c2b098b-51b0-4207-a5d0-88a0a07f785f service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1a7e47c-7436-470e-aeaf-ded0a3242d97 req-3c2b098b-51b0-4207-a5d0-88a0a07f785f service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1a7e47c-7436-470e-aeaf-ded0a3242d97 req-3c2b098b-51b0-4207-a5d0-88a0a07f785f service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] No waiting events found dispatching network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:22:38 user nova-compute[75071]: WARNING nova.compute.manager [req-b1a7e47c-7436-470e-aeaf-ded0a3242d97 req-3c2b098b-51b0-4207-a5d0-88a0a07f785f service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received unexpected event network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e for instance with vm_state building and task_state spawning.
Nov 29 13:22:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:22:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Instance spawned successfully.
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:22:38 user nova-compute[75071]: INFO nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 29 13:22:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:22:38 user nova-compute[75071]: INFO nova.compute.manager [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Took 6.96 seconds to build instance.
Nov 29 13:22:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b76d3fd0-22e7-4e18-a856-3f6b6fbb96b6 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.084s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:22:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:47 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:47 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7553MB free_disk=25.212020874023438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Applying migration context for instance 6935d835-c98f-4355-8031-4436125925f1 as it has an incoming, in-progress migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d. Migration status is finished {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 13:22:47 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating resource usage from migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 014f79bb-e808-49e1-8d7a-c058b99c8377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 2ae7c6e1-1feb-413d-b11d-aa6ff502d292 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:22:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:22:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updating instance_info_cache with network_info: [{"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-014f79bb-e808-49e1-8d7a-c058b99c8377" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:22:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:22:54 user nova-compute[75071]: INFO nova.compute.claims [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Claim successful on node user
Nov 29 13:22:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:22:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.policy [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f902428dcca045ffa81dbd8fd53048b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd1e8292884439b8d49dd698bf812e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:22:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Creating image(s)
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk 1073741824" returned: 0 in 0.047s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Successfully created port: c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Cannot resize image /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Ensure instance console log exists: /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Successfully updated port: c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:22:56 user nova-compute[75071]: INFO nova.compute.claims [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Claim successful on node user
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received event network-changed-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Refreshing instance network info cache due to event network-changed-c0cc9c18-c776-4177-b726-c19ac5dd2284. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] Acquiring lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updating instance_info_cache with network_info: [{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Instance network_info: |[{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] Acquired lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Refreshing network info cache for port c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Start _get_guest_xml network_info=[{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:22:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2119767777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2119767777',id=16,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-tlh6esp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:55Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=a0bdb312-835a-499a-af02-58f5f25f50e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:82:e0,bridge_name='br-int',has_traffic_filtering=True,id=c0cc9c18-c776-4177-b726-c19ac5dd2284,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cc9c18-c7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'pci_devices' on Instance uuid a0bdb312-835a-499a-af02-58f5f25f50e9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:22:57 user nova-compute[75071]:   <uuid>a0bdb312-835a-499a-af02-58f5f25f50e9</uuid>
Nov 29 13:22:57 user nova-compute[75071]:   <name>instance-00000010</name>
Nov 29 13:22:57 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:22:57 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:22:57 user nova-compute[75071]:   <metadata>
Nov 29 13:22:57 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:22:57 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:22:57 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2119767777</nova:name>
Nov 29 13:22:57 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:22:57</nova:creationTime>
Nov 29 13:22:57 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:22:57 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:22:57 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:22:57 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:22:57 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:22:57 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:22:57 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:22:57 user nova-compute[75071]:       <nova:owner>
Nov 29 13:22:57 user nova-compute[75071]:         <nova:user uuid="f902428dcca045ffa81dbd8fd53048b6">tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member</nova:user>
Nov 29 13:22:57 user nova-compute[75071]:         <nova:project uuid="ecd1e8292884439b8d49dd698bf812e1">tempest-ServerBootFromVolumeStableRescueTest-398011867</nova:project>
Nov 29 13:22:57 user nova-compute[75071]:       </nova:owner>
Nov 29 13:22:57 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:22:57 user nova-compute[75071]:       <nova:ports>
Nov 29 13:22:57 user nova-compute[75071]:         <nova:port uuid="c0cc9c18-c776-4177-b726-c19ac5dd2284">
Nov 29 13:22:57 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 13:22:57 user nova-compute[75071]:         </nova:port>
Nov 29 13:22:57 user nova-compute[75071]:       </nova:ports>
Nov 29 13:22:57 user nova-compute[75071]:     </nova:instance>
Nov 29 13:22:57 user nova-compute[75071]:   </metadata>
Nov 29 13:22:57 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:22:57 user nova-compute[75071]:     <system>
Nov 29 13:22:57 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:22:57 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:22:57 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:22:57 user nova-compute[75071]:       <entry name="serial">a0bdb312-835a-499a-af02-58f5f25f50e9</entry>
Nov 29 13:22:57 user nova-compute[75071]:       <entry name="uuid">a0bdb312-835a-499a-af02-58f5f25f50e9</entry>
Nov 29 13:22:57 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:22:57 user nova-compute[75071]:     </system>
Nov 29 13:22:57 user nova-compute[75071]:   </sysinfo>
Nov 29 13:22:57 user nova-compute[75071]:   <os>
Nov 29 13:22:57 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:22:57 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:22:57 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:22:57 user nova-compute[75071]:   </os>
Nov 29 13:22:57 user nova-compute[75071]:   <features>
Nov 29 13:22:57 user nova-compute[75071]:     <acpi/>
Nov 29 13:22:57 user nova-compute[75071]:     <apic/>
Nov 29 13:22:57 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:22:57 user nova-compute[75071]:   </features>
Nov 29 13:22:57 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:22:57 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:22:57 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:22:57 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:22:57 user nova-compute[75071]:   </clock>
Nov 29 13:22:57 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:22:57 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:22:57 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:22:57 user nova-compute[75071]:   </cpu>
Nov 29 13:22:57 user nova-compute[75071]:   <devices>
Nov 29 13:22:57 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:22:57 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:22:57 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk"/>
Nov 29 13:22:57 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:22:57 user nova-compute[75071]:     </disk>
Nov 29 13:22:57 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:22:57 user nova-compute[75071]:       <mac address="fa:16:3e:59:82:e0"/>
Nov 29 13:22:57 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:57 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:22:57 user nova-compute[75071]:       <target dev="tapc0cc9c18-c7"/>
Nov 29 13:22:57 user nova-compute[75071]:     </interface>
Nov 29 13:22:57 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:22:57 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/console.log" append="off"/>
Nov 29 13:22:57 user nova-compute[75071]:     </serial>
Nov 29 13:22:57 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:22:57 user nova-compute[75071]:     <video>
Nov 29 13:22:57 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:22:57 user nova-compute[75071]:     </video>
Nov 29 13:22:57 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:22:57 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:22:57 user nova-compute[75071]:     </rng>
Nov 29 13:22:57 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:22:57 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:22:57 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:22:57 user nova-compute[75071]:     </memballoon>
Nov 29 13:22:57 user nova-compute[75071]:   </devices>
Nov 29 13:22:57 user nova-compute[75071]: </domain>
Nov 29 13:22:57 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2119767777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2119767777',id=16,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-tlh6esp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:55Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=a0bdb312-835a-499a-af02-58f5f25f50e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:82:e0,bridge_name='br-int',has_traffic_filtering=True,id=c0cc9c18-c776-4177-b726-c19ac5dd2284,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cc9c18-c7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG os_vif [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:82:e0,bridge_name='br-int',has_traffic_filtering=True,id=c0cc9c18-c776-4177-b726-c19ac5dd2284,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cc9c18-c7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ac4f873-ffba-55b2-88ca-58ae0418eccb', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0cc9c18-c7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0cc9c18-c7, col_values=(('qos', UUID('e3e9d16a-b3aa-4b5b-8c6e-3bc23430ccd8')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0cc9c18-c7, col_values=(('external_ids', {'iface-id': 'c0cc9c18-c776-4177-b726-c19ac5dd2284', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:82:e0', 'vm-uuid': 'a0bdb312-835a-499a-af02-58f5f25f50e9'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:57 user nova-compute[75071]: INFO os_vif [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:82:e0,bridge_name='br-int',has_traffic_filtering=True,id=c0cc9c18-c776-4177-b726-c19ac5dd2284,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cc9c18-c7')
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No VIF found with MAC fa:16:3e:59:82:e0, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:22:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.policy [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef26a0d898244c73be33730e771e037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f748a7e2162477ba4aeb4e16f349f37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:22:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Creating image(s)
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "/opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "/opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "/opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "1bc049b227ee6e59f16cd06f1dda7e59a99be547" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "1bc049b227ee6e59f16cd06f1dda7e59a99be547" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updated VIF entry in instance network info cache for port c0cc9c18-c776-4177-b726-c19ac5dd2284. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updating instance_info_cache with network_info: [{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b41649b-6b51-469e-9076-6cd02b20e10b req-c4df5eae-cf4c-4724-9143-96436a9eff12 service nova] Releasing lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG nova.virt.images [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] 0ad74a75-840b-4e74-834a-3772a04de1d6 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.part /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Successfully created port: ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.part /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.converted" returned: 0 in 0.333s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "1bc049b227ee6e59f16cd06f1dda7e59a99be547" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.250s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547 --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "1bc049b227ee6e59f16cd06f1dda7e59a99be547" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "1bc049b227ee6e59f16cd06f1dda7e59a99be547" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547 --force-share --output=json" returned: 0 in 0.242s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547,backing_fmt=raw /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547,backing_fmt=raw /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk 1073741824" returned: 0 in 0.053s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "1bc049b227ee6e59f16cd06f1dda7e59a99be547" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Successfully updated port: ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-changed-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Refreshing instance network info cache due to event network-changed-ebfc46f1-0f4a-48af-93ce-d09eb4910676. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] Acquiring lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] Acquired lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Refreshing network info cache for port ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547 --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Cannot resize image /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Ensure instance console log exists: /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3bb76322-177e-4e8b-8221-68cd258574c9 req-97ed2cc1-a41e-4cc6-b791-ebbb461ae031 service nova] Releasing lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquired lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:22:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Updating instance_info_cache with network_info: [{"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Releasing lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Instance network_info: |[{"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Start _get_guest_xml network_info=[{"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:22:51Z,direct_url=<?>,disk_format='qcow2',id=0ad74a75-840b-4e74-834a-3772a04de1d6,min_disk=0,min_ram=0,name='',owner='5e702bc55f9e4dec91af4d8077ca1f97',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:22:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/sda', 'image_id': '0ad74a75-840b-4e74-834a-3772a04de1d6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:23:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:23:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:22:51Z,direct_url=<?>,disk_format='qcow2',id=0ad74a75-840b-4e74-834a-3772a04de1d6,min_disk=0,min_ram=0,name='',owner='5e702bc55f9e4dec91af4d8077ca1f97',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:22:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1878803636',display_name='tempest-AttachSCSIVolumeTestJSON-server-1878803636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1878803636',id=17,image_ref='0ad74a75-840b-4e74-834a-3772a04de1d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBMKwBbgQ4xBUaM12lzIawHHfm3dQ0bygVqr79aRYbGlVPxU3i2ce78PoEUJroGZz7y7Ni2TphaD0c9XtmLW76i8IMxqXExJUeYMPbBl99s4TIObwUcfpQ8s9tm7aTC3w==',key_name='tempest-keypair-1848736999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f748a7e2162477ba4aeb4e16f349f37',ramdisk_id='',reservation_id='r-pcqea6m0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0ad74a75-840b-4e74-834a-3772a04de1d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2028645872',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2028645872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef26a0d898244c73be33730e771e037a',uuid=03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Converting VIF {"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:4b:a7,bridge_name='br-int',has_traffic_filtering=True,id=ebfc46f1-0f4a-48af-93ce-d09eb4910676,network=Network(748c3fe8-f18e-494f-8211-c0cdd1b61e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfc46f1-0f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lazy-loading 'pci_devices' on Instance uuid 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:23:00 user nova-compute[75071]:   <uuid>03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b</uuid>
Nov 29 13:23:00 user nova-compute[75071]:   <name>instance-00000011</name>
Nov 29 13:23:00 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:23:00 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:23:00 user nova-compute[75071]:   <metadata>
Nov 29 13:23:00 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:23:00 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:23:00 user nova-compute[75071]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1878803636</nova:name>
Nov 29 13:23:00 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:23:00</nova:creationTime>
Nov 29 13:23:00 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:23:00 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:23:00 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:23:00 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:23:00 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:23:00 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:23:00 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:23:00 user nova-compute[75071]:       <nova:owner>
Nov 29 13:23:00 user nova-compute[75071]:         <nova:user uuid="ef26a0d898244c73be33730e771e037a">tempest-AttachSCSIVolumeTestJSON-2028645872-project-member</nova:user>
Nov 29 13:23:00 user nova-compute[75071]:         <nova:project uuid="3f748a7e2162477ba4aeb4e16f349f37">tempest-AttachSCSIVolumeTestJSON-2028645872</nova:project>
Nov 29 13:23:00 user nova-compute[75071]:       </nova:owner>
Nov 29 13:23:00 user nova-compute[75071]:       <nova:root type="image" uuid="0ad74a75-840b-4e74-834a-3772a04de1d6"/>
Nov 29 13:23:00 user nova-compute[75071]:       <nova:ports>
Nov 29 13:23:00 user nova-compute[75071]:         <nova:port uuid="ebfc46f1-0f4a-48af-93ce-d09eb4910676">
Nov 29 13:23:00 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:23:00 user nova-compute[75071]:         </nova:port>
Nov 29 13:23:00 user nova-compute[75071]:       </nova:ports>
Nov 29 13:23:00 user nova-compute[75071]:     </nova:instance>
Nov 29 13:23:00 user nova-compute[75071]:   </metadata>
Nov 29 13:23:00 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:23:00 user nova-compute[75071]:     <system>
Nov 29 13:23:00 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:23:00 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:23:00 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:23:00 user nova-compute[75071]:       <entry name="serial">03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b</entry>
Nov 29 13:23:00 user nova-compute[75071]:       <entry name="uuid">03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b</entry>
Nov 29 13:23:00 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:23:00 user nova-compute[75071]:     </system>
Nov 29 13:23:00 user nova-compute[75071]:   </sysinfo>
Nov 29 13:23:00 user nova-compute[75071]:   <os>
Nov 29 13:23:00 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:23:00 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:23:00 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:23:00 user nova-compute[75071]:   </os>
Nov 29 13:23:00 user nova-compute[75071]:   <features>
Nov 29 13:23:00 user nova-compute[75071]:     <acpi/>
Nov 29 13:23:00 user nova-compute[75071]:     <apic/>
Nov 29 13:23:00 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:23:00 user nova-compute[75071]:   </features>
Nov 29 13:23:00 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:23:00 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:23:00 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:23:00 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:23:00 user nova-compute[75071]:   </clock>
Nov 29 13:23:00 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:23:00 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:23:00 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:23:00 user nova-compute[75071]:   </cpu>
Nov 29 13:23:00 user nova-compute[75071]:   <devices>
Nov 29 13:23:00 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:23:00 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:23:00 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk"/>
Nov 29 13:23:00 user nova-compute[75071]:       <target dev="sda" bus="scsi"/>
Nov 29 13:23:00 user nova-compute[75071]:       <address type="drive" controller="0" unit="0"/>
Nov 29 13:23:00 user nova-compute[75071]:     </disk>
Nov 29 13:23:00 user nova-compute[75071]:     <disk type="file" device="cdrom">
Nov 29 13:23:00 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 13:23:00 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk.config"/>
Nov 29 13:23:00 user nova-compute[75071]:       <target dev="sdb" bus="scsi"/>
Nov 29 13:23:00 user nova-compute[75071]:       <address type="drive" controller="0" unit="1"/>
Nov 29 13:23:00 user nova-compute[75071]:     </disk>
Nov 29 13:23:00 user nova-compute[75071]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 13:23:00 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:23:00 user nova-compute[75071]:       <mac address="fa:16:3e:d2:4b:a7"/>
Nov 29 13:23:00 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:23:00 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:23:00 user nova-compute[75071]:       <target dev="tapebfc46f1-0f"/>
Nov 29 13:23:00 user nova-compute[75071]:     </interface>
Nov 29 13:23:00 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:23:00 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/console.log" append="off"/>
Nov 29 13:23:00 user nova-compute[75071]:     </serial>
Nov 29 13:23:00 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:23:00 user nova-compute[75071]:     <video>
Nov 29 13:23:00 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:23:00 user nova-compute[75071]:     </video>
Nov 29 13:23:00 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:23:00 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:23:00 user nova-compute[75071]:     </rng>
Nov 29 13:23:00 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:23:00 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:23:00 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:23:00 user nova-compute[75071]:     </memballoon>
Nov 29 13:23:00 user nova-compute[75071]:   </devices>
Nov 29 13:23:00 user nova-compute[75071]: </domain>
Nov 29 13:23:00 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1878803636',display_name='tempest-AttachSCSIVolumeTestJSON-server-1878803636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1878803636',id=17,image_ref='0ad74a75-840b-4e74-834a-3772a04de1d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBMKwBbgQ4xBUaM12lzIawHHfm3dQ0bygVqr79aRYbGlVPxU3i2ce78PoEUJroGZz7y7Ni2TphaD0c9XtmLW76i8IMxqXExJUeYMPbBl99s4TIObwUcfpQ8s9tm7aTC3w==',key_name='tempest-keypair-1848736999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f748a7e2162477ba4aeb4e16f349f37',ramdisk_id='',reservation_id='r-pcqea6m0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0ad74a75-840b-4e74-834a-3772a04de1d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2028645872',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2028645872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef26a0d898244c73be33730e771e037a',uuid=03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Converting VIF {"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:4b:a7,bridge_name='br-int',has_traffic_filtering=True,id=ebfc46f1-0f4a-48af-93ce-d09eb4910676,network=Network(748c3fe8-f18e-494f-8211-c0cdd1b61e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfc46f1-0f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG os_vif [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:4b:a7,bridge_name='br-int',has_traffic_filtering=True,id=ebfc46f1-0f4a-48af-93ce-d09eb4910676,network=Network(748c3fe8-f18e-494f-8211-c0cdd1b61e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfc46f1-0f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cab7b432-6051-595b-888f-69fe98c7329a', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebfc46f1-0f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebfc46f1-0f, col_values=(('qos', UUID('82f6c2a2-cf5a-481e-9685-43de5fa84b23')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebfc46f1-0f, col_values=(('external_ids', {'iface-id': 'ebfc46f1-0f4a-48af-93ce-d09eb4910676', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:4b:a7', 'vm-uuid': '03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:00 user nova-compute[75071]: INFO os_vif [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:4b:a7,bridge_name='br-int',has_traffic_filtering=True,id=ebfc46f1-0f4a-48af-93ce-d09eb4910676,network=Network(748c3fe8-f18e-494f-8211-c0cdd1b61e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfc46f1-0f')
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] No BDM found with device name sda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] No VIF found with MAC fa:16:3e:d2:4b:a7, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:23:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Using config drive
Nov 29 13:23:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Creating config drive at /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk.config
Nov 29 13:23:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9n9l98hg {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9n9l98hg" returned: 0 in 0.090s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:23:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Instance spawned successfully.
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:01 user nova-compute[75071]: INFO nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:23:01 user nova-compute[75071]: INFO nova.compute.manager [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Took 7.23 seconds to build instance.
Nov 29 13:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0436b3e5-7852-4fb4-a3bf-71f047201897 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.338s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-5a65b46a-b78f-4e2a-958b-81adbcd94e8c req-6bc75844-3852-441f-96fa-fdd1050d1594 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received event network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5a65b46a-b78f-4e2a-958b-81adbcd94e8c req-6bc75844-3852-441f-96fa-fdd1050d1594 service nova] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5a65b46a-b78f-4e2a-958b-81adbcd94e8c req-6bc75844-3852-441f-96fa-fdd1050d1594 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5a65b46a-b78f-4e2a-958b-81adbcd94e8c req-6bc75844-3852-441f-96fa-fdd1050d1594 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-5a65b46a-b78f-4e2a-958b-81adbcd94e8c req-6bc75844-3852-441f-96fa-fdd1050d1594 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] No waiting events found dispatching network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:01 user nova-compute[75071]: WARNING nova.compute.manager [req-5a65b46a-b78f-4e2a-958b-81adbcd94e8c req-6bc75844-3852-441f-96fa-fdd1050d1594 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received unexpected event network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 for instance with vm_state active and task_state None.
Nov 29 13:23:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received event network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] No waiting events found dispatching network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:03 user nova-compute[75071]: WARNING nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received unexpected event network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 for instance with vm_state active and task_state None.
Nov 29 13:23:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] No waiting events found dispatching network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:03 user nova-compute[75071]: WARNING nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received unexpected event network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 for instance with vm_state building and task_state spawning.
Nov 29 13:23:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] No waiting events found dispatching network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:03 user nova-compute[75071]: WARNING nova.compute.manager [req-8123951b-c981-456c-adce-d5cd07a19ae7 req-2dc9af60-184b-4815-bac7-3a14a043ed01 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received unexpected event network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 for instance with vm_state building and task_state spawning.
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:23:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Instance spawned successfully.
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:04 user nova-compute[75071]: INFO nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 29 13:23:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:23:04 user nova-compute[75071]: INFO nova.compute.manager [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Took 8.27 seconds to build instance.
Nov 29 13:23:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3fa9b8fc-9218-4f0a-b39a-23bde59fb6b7 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.411s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:05 user nova-compute[75071]: INFO nova.compute.manager [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Terminating instance
Nov 29 13:23:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Instance destroyed successfully.
Nov 29 13:23:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lazy-loading 'resources' on Instance uuid 2ae7c6e1-1feb-413d-b11d-aa6ff502d292 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1471014675',display_name='tempest-VolumesAdminNegativeTest-server-1471014675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1471014675',id=13,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5c2c9d59234462091e0e4548c770d12',ramdisk_id='',reservation_id='r-d78gyzoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-984213226',owner_user_name='tempest-VolumesAdminNegativeTest-984213226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:21:14Z,user_data=None,user_id='44500d2105a742ddacaf6e766f042bf2',uuid=2ae7c6e1-1feb-413d-b11d-aa6ff502d292,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converting VIF {"id": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "address": "fa:16:3e:8f:4d:39", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a84dc1-9f", "ovs_interfaceid": "82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:39,bridge_name='br-int',has_traffic_filtering=True,id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a84dc1-9f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG os_vif [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:39,bridge_name='br-int',has_traffic_filtering=True,id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a84dc1-9f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82a84dc1-9f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3f197de-662e-4f85-a54a-dfb5ea06a0f8) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:06 user nova-compute[75071]: INFO os_vif [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:39,bridge_name='br-int',has_traffic_filtering=True,id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a84dc1-9f')
Nov 29 13:23:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Deleting instance files /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292_del
Nov 29 13:23:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Deletion of /opt/stack/data/nova/instances/2ae7c6e1-1feb-413d-b11d-aa6ff502d292_del complete
Nov 29 13:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:06 user nova-compute[75071]: INFO nova.compute.manager [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 29 13:23:06 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:23:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:07 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Took 0.70 seconds to deallocate network for instance.
Nov 29 13:23:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-a2e3cebd-fe0c-4c9b-adf2-51614fdbf690 req-e182ad7b-c90f-4ce0-bdc3-3be8b56ef8c3 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Received event network-vif-deleted-82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:07 user nova-compute[75071]: INFO nova.compute.manager [req-a2e3cebd-fe0c-4c9b-adf2-51614fdbf690 req-e182ad7b-c90f-4ce0-bdc3-3be8b56ef8c3 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Neutron deleted interface 82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9; detaching it from the instance and deleting it from the info cache
Nov 29 13:23:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-a2e3cebd-fe0c-4c9b-adf2-51614fdbf690 req-e182ad7b-c90f-4ce0-bdc3-3be8b56ef8c3 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-a2e3cebd-fe0c-4c9b-adf2-51614fdbf690 req-e182ad7b-c90f-4ce0-bdc3-3be8b56ef8c3 service nova] [instance: 2ae7c6e1-1feb-413d-b11d-aa6ff502d292] Detach interface failed, port_id=82a84dc1-9fb3-417b-bba7-8ece6a8ecbc9, reason: Instance 2ae7c6e1-1feb-413d-b11d-aa6ff502d292 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:23:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:23:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:08 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Deleted allocations for instance 2ae7c6e1-1feb-413d-b11d-aa6ff502d292
Nov 29 13:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1e6eb811-52c1-4db5-af81-7e07135e7eb4 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "2ae7c6e1-1feb-413d-b11d-aa6ff502d292" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.714s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:21 user nova-compute[75071]: INFO nova.compute.manager [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Unshelving
Nov 29 13:23:21 user nova-compute[75071]: INFO nova.virt.block_device [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Booting with volume 49892357-0234-42db-918a-026a37e4f1f1 at /dev/vda
Nov 29 13:23:21 user nova-compute[75071]: DEBUG os_brick.utils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed479e8-387b-454b-be80-2079aa388503]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0389a46-d439-4a6a-8b72-38c66c193dcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83a64c-b107-482f-a531-999c2eb1ba6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3702b3-4af3-4d66-912f-947e93e385bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:21 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:23:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69993399-2af7-4a93-8669-2228a78fb108]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG os_brick.utils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:21 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating existing volume attachment record: 40349855-411a-4362-ba87-c4056cf0c7e9 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:23:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-changed-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Refreshing instance network info cache due to event network-changed-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] Acquiring lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] Acquired lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Refreshing network info cache for port b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'flavor' on Instance uuid 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'pci_requests' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'numa_topology' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:23:29 user nova-compute[75071]: INFO nova.compute.claims [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Claim successful on node user
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updated VIF entry in instance network info cache for port b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updating instance_info_cache with network_info: [{"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:29 user nova-compute[75071]: INFO nova.compute.manager [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Attaching volume 2ecf8b34-b51c-497c-b64a-6ad3229a18ef to /dev/vdb
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bd4c44d2-def7-4dcd-ad55-6a04d1de36ad req-7302ac34-b365-4d77-b228-bf6a2a4e684e service nova] Releasing lock "refresh_cache-05b48a8b-440a-4af0-81fa-d362302c1bb8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG os_brick.utils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9c70af-9e42-48e7-a951-f2e05f9111a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfd13a8-367a-4812-9210-9c672a197949]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03916975-532a-41c6-8cb2-340ff1c054a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e76759d-8b49-4f01-8770-3cc9a50bc75f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:29 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:23:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c3438e-23eb-4e4c-bb57-29a1c0ee5e46]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG os_brick.utils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updating existing volume attachment record: 1742f742-32b4-4ad8-b243-7cb6405d96f9 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:30 user nova-compute[75071]: INFO nova.network.neutron [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating port ebb73234-ca47-4314-a8e2-a16cce479217 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquired lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Releasing lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:23:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Creating image(s)
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Ensure instance console log exists: /opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Start _get_guest_xml network_info=[{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89d407c4-7e0e-4213-a2a2-99d547c42a4c', 'attached_at': '', 'detached_at': '', 'volume_id': '49892357-0234-42db-918a-026a37e4f1f1', 'serial': '49892357-0234-42db-918a-026a37e4f1f1'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '40349855-411a-4362-ba87-c4056cf0c7e9', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:23:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:23:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'vcpu_model' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing instance network info cache due to event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] Acquiring lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] Acquired lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.objects.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Object Instance<89d407c4-7e0e-4213-a2a2-99d547c42a4c> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:31 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[91abb5f8-ea5b-4fa8-bcab-7588b6c3ec09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:23:31 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a070a6-1e9e-425b-8fee-9360c86874cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1] added
Nov 29 13:23:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a746c899-6a19-4f5b-8f86-2b8113b4c334]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d7d292-3595-46d4-adef-bc46b0431044]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCiILDgZ {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uCiILDgZ" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9b07a-fccd-45f0-82ac-fefb86b6a15b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uCiILDgZ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50384e5-2ff1-416a-9df8-d0f007d40ed3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe99718-d704-4bac-9d41-e8eb3638accd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bccdea9-3dfc-490a-8218-cb77ba308015]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]
Nov 29 13:23:31 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.
Nov 29 13:23:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5381388-e7cb-4551-ad90-d5ee90af7fe3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5402384-b364-4ce2-a9ec-607e145bb011]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:31 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[743eb26c-2b6b-4940-a8d3-011ca1c4050f]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updated VIF entry in instance network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-871b1d6d-bc73-49bb-854a-42786497a320 req-d4e73ac0-3301-477a-ba5f-05c82f29715d service nova] Releasing lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23739633431303236', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739633431303236', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-878992995',display_name='tempest-TestShelveInstance-server-878992995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-878992995',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-76113716',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:20:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e33dac7a205d476ba368ab85fa20387d',ramdisk_id='',reservation_id='r-3amg8rr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-260027550',owner_user_name='tempest-TestShelveInstance-260027550-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:23:22Z,user_data=None,user_id='754229134eaf4fd18d8b0680e74ddd90',uuid=89d407c4-7e0e-4213-a2a2-99d547c42a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converting VIF {"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'pci_devices' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.objects.base [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Object Instance<89d407c4-7e0e-4213-a2a2-99d547c42a4c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:23:32 user nova-compute[75071]:   <uuid>89d407c4-7e0e-4213-a2a2-99d547c42a4c</uuid>
Nov 29 13:23:32 user nova-compute[75071]:   <name>instance-0000000a</name>
Nov 29 13:23:32 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:23:32 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:23:32 user nova-compute[75071]:   <metadata>
Nov 29 13:23:32 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:23:32 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:23:32 user nova-compute[75071]:       <nova:name>tempest-TestShelveInstance-server-878992995</nova:name>
Nov 29 13:23:32 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:23:31</nova:creationTime>
Nov 29 13:23:32 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:23:32 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:23:32 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:23:32 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:23:32 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:23:32 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:23:32 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:23:32 user nova-compute[75071]:       <nova:owner>
Nov 29 13:23:32 user nova-compute[75071]:         <nova:user uuid="754229134eaf4fd18d8b0680e74ddd90">tempest-TestShelveInstance-260027550-project-member</nova:user>
Nov 29 13:23:32 user nova-compute[75071]:         <nova:project uuid="e33dac7a205d476ba368ab85fa20387d">tempest-TestShelveInstance-260027550</nova:project>
Nov 29 13:23:32 user nova-compute[75071]:       </nova:owner>
Nov 29 13:23:32 user nova-compute[75071]:       <nova:ports>
Nov 29 13:23:32 user nova-compute[75071]:         <nova:port uuid="ebb73234-ca47-4314-a8e2-a16cce479217">
Nov 29 13:23:32 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 13:23:32 user nova-compute[75071]:         </nova:port>
Nov 29 13:23:32 user nova-compute[75071]:       </nova:ports>
Nov 29 13:23:32 user nova-compute[75071]:     </nova:instance>
Nov 29 13:23:32 user nova-compute[75071]:   </metadata>
Nov 29 13:23:32 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:23:32 user nova-compute[75071]:     <system>
Nov 29 13:23:32 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:23:32 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:23:32 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:23:32 user nova-compute[75071]:       <entry name="serial">89d407c4-7e0e-4213-a2a2-99d547c42a4c</entry>
Nov 29 13:23:32 user nova-compute[75071]:       <entry name="uuid">89d407c4-7e0e-4213-a2a2-99d547c42a4c</entry>
Nov 29 13:23:32 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:23:32 user nova-compute[75071]:     </system>
Nov 29 13:23:32 user nova-compute[75071]:   </sysinfo>
Nov 29 13:23:32 user nova-compute[75071]:   <os>
Nov 29 13:23:32 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:23:32 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:23:32 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:23:32 user nova-compute[75071]:   </os>
Nov 29 13:23:32 user nova-compute[75071]:   <features>
Nov 29 13:23:32 user nova-compute[75071]:     <acpi/>
Nov 29 13:23:32 user nova-compute[75071]:     <apic/>
Nov 29 13:23:32 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:23:32 user nova-compute[75071]:   </features>
Nov 29 13:23:32 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:23:32 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:23:32 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:23:32 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:23:32 user nova-compute[75071]:   </clock>
Nov 29 13:23:32 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:23:32 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:23:32 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:23:32 user nova-compute[75071]:   </cpu>
Nov 29 13:23:32 user nova-compute[75071]:   <devices>
Nov 29 13:23:32 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:23:32 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:23:32 user nova-compute[75071]:       <source dev="/dev/sde"/>
Nov 29 13:23:32 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:23:32 user nova-compute[75071]:       <serial>49892357-0234-42db-918a-026a37e4f1f1</serial>
Nov 29 13:23:32 user nova-compute[75071]:     </disk>
Nov 29 13:23:32 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:23:32 user nova-compute[75071]:       <mac address="fa:16:3e:49:68:09"/>
Nov 29 13:23:32 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:23:32 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:23:32 user nova-compute[75071]:       <target dev="tapebb73234-ca"/>
Nov 29 13:23:32 user nova-compute[75071]:     </interface>
Nov 29 13:23:32 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:23:32 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c/console.log" append="off"/>
Nov 29 13:23:32 user nova-compute[75071]:     </serial>
Nov 29 13:23:32 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:23:32 user nova-compute[75071]:     <video>
Nov 29 13:23:32 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:23:32 user nova-compute[75071]:     </video>
Nov 29 13:23:32 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:23:32 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:23:32 user nova-compute[75071]:     </rng>
Nov 29 13:23:32 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:23:32 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:23:32 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:23:32 user nova-compute[75071]:     </memballoon>
Nov 29 13:23:32 user nova-compute[75071]:   </devices>
Nov 29 13:23:32 user nova-compute[75071]: </domain>
Nov 29 13:23:32 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-878992995',display_name='tempest-TestShelveInstance-server-878992995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-878992995',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-76113716',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:20:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e33dac7a205d476ba368ab85fa20387d',ramdisk_id='',reservation_id='r-3amg8rr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-260027550',owner_user_name='tempest-TestShelveInstance-260027550-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:23:22Z,user_data=None,user_id='754229134eaf4fd18d8b0680e74ddd90',uuid=89d407c4-7e0e-4213-a2a2-99d547c42a4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converting VIF {"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG os_vif [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b700fbc7-fbf0-58cc-bfd0-1378211f4379', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb73234-ca, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb73234-ca, col_values=(('qos', UUID('e36c8243-89f5-4410-86b3-0242cad042e9')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb73234-ca, col_values=(('external_ids', {'iface-id': 'ebb73234-ca47-4314-a8e2-a16cce479217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:68:09', 'vm-uuid': '89d407c4-7e0e-4213-a2a2-99d547c42a4c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:32 user nova-compute[75071]: INFO os_vif [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca')
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:23:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] No VIF found with MAC fa:16:3e:49:68:09, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:23:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "84b6410e-14ea-49ad-98f0-32933047ba58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:23:34 user nova-compute[75071]: INFO nova.compute.claims [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Claim successful on node user
Nov 29 13:23:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-338392ba-f6ee-4d62-b1a2-23fc2bd04fa4 req-beb59edb-89d0-478a-a721-dec1a9f2bf9e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-338392ba-f6ee-4d62-b1a2-23fc2bd04fa4 req-beb59edb-89d0-478a-a721-dec1a9f2bf9e service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-338392ba-f6ee-4d62-b1a2-23fc2bd04fa4 req-beb59edb-89d0-478a-a721-dec1a9f2bf9e service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-338392ba-f6ee-4d62-b1a2-23fc2bd04fa4 req-beb59edb-89d0-478a-a721-dec1a9f2bf9e service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-338392ba-f6ee-4d62-b1a2-23fc2bd04fa4 req-beb59edb-89d0-478a-a721-dec1a9f2bf9e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:34 user nova-compute[75071]: WARNING nova.compute.manager [req-338392ba-f6ee-4d62-b1a2-23fc2bd04fa4 req-beb59edb-89d0-478a-a721-dec1a9f2bf9e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received unexpected event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 13:23:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.780s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:23:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:23:35 user nova-compute[75071]: INFO nova.virt.block_device [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Booting with volume caccff51-1c91-429a-83a0-b0be3d846504 at /dev/vda
Nov 29 13:23:35 user nova-compute[75071]: DEBUG os_brick.utils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.policy [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '033f984ade194139a635d47665a80928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d76574df8c4c1e975d3d75bcefe011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f17efbc-7bbe-42a4-aa27-8ee57f09c1b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc14b13b-5ae6-4bde-bc50-954ef0c99087]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee99100-c8af-45c7-b047-adb7407d2c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19edbc-34af-4645-a106-153032932776]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:35 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:23:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aefee42-6041-4089-a5f8-4fbc44fc9f8f]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG os_brick.utils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:35 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating existing volume attachment record: 1f8ce4dc-99d6-46e6-a8e8-895d2ebdcb4c {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully created port: 12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-e671057b-fd97-4470-a13e-78982d360bcb req-430053ea-bd45-42c9-a8c2-4f2311b9f375 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e671057b-fd97-4470-a13e-78982d360bcb req-430053ea-bd45-42c9-a8c2-4f2311b9f375 service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e671057b-fd97-4470-a13e-78982d360bcb req-430053ea-bd45-42c9-a8c2-4f2311b9f375 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e671057b-fd97-4470-a13e-78982d360bcb req-430053ea-bd45-42c9-a8c2-4f2311b9f375 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-e671057b-fd97-4470-a13e-78982d360bcb req-430053ea-bd45-42c9-a8c2-4f2311b9f375 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:36 user nova-compute[75071]: WARNING nova.compute.manager [req-e671057b-fd97-4470-a13e-78982d360bcb req-430053ea-bd45-42c9-a8c2-4f2311b9f375 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received unexpected event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 13:23:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:23:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance spawned successfully.
Nov 29 13:23:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5a34a27-9af8-4c4a-b80e-81a178cadeeb tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.255s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully created port: bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:23:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully created port: f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:23:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:38 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:38 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:38 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceb8168-3225-4aa0-b753-ba7305ed92d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:23:38 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8ad3f-c444-4e3b-b0a7-3b5e4f59b789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef] added
Nov 29 13:23:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[becae90b-ef05-4294-a84a-88c7519d1c7a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c96fc58-e573-4af1-8cbb-56a509939c38]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRzJxQeh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRzJxQeh" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d27d72-da94-4eeb-ac88-d730502b7e4b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRzJxQeh'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully created port: b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0117098-2800-4ce4-9bdb-cc695b4d9cdc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f8557-97e8-42ed-9020-566e4ad96407]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d971c0-da56-4d2e-aad7-f94408f17a47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]
Nov 29 13:23:38 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.
Nov 29 13:23:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef51db-67e0-4864-a614-a67caad574b1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b527d23a-b768-4d99-8076-dc453959d149]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:23:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:38 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:23:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d0d3c-d1c9-428c-89d3-7dc91ca3f5f0]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:23:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully created port: 149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23865623163616665', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865623163616665', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'flavor' on Instance uuid 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully updated port: 12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:23:39 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:23:39 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:23:39 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:23:39 user nova-compute[75071]:   <serial>2ecf8b34-b51c-497c-b64a-6ad3229a18ef</serial>
Nov 29 13:23:39 user nova-compute[75071]: </disk>
Nov 29 13:23:39 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port 12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No VIF found with MAC fa:16:3e:1f:41:4b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da3d779e-7d83-4e51-9c0a-15bf36d31e17 req-6a35c278-3810-47d5-adfe-ce241cbf3b46 service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d82d51f3-5d67-4ba6-bc98-ab3b49cfecf0 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.480s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully updated port: 4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully updated port: 2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:23:41 user nova-compute[75071]: INFO nova.compute.manager [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Rebuilding instance
Nov 29 13:23:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully updated port: bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-4b2e7ffe-9534-4809-9de9-63a997b0da9a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port 4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:23:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-2ddafa0f-75cc-434f-8a5f-164201102d76. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port 2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-14d016d5-7772-4fdc-bdee-4d246713e39f req-6dd4ba70-908c-4765-a58d-4ceed8af9237 service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-unplugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14d016d5-7772-4fdc-bdee-4d246713e39f req-6dd4ba70-908c-4765-a58d-4ceed8af9237 service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14d016d5-7772-4fdc-bdee-4d246713e39f req-6dd4ba70-908c-4765-a58d-4ceed8af9237 service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14d016d5-7772-4fdc-bdee-4d246713e39f req-6dd4ba70-908c-4765-a58d-4ceed8af9237 service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-14d016d5-7772-4fdc-bdee-4d246713e39f req-6dd4ba70-908c-4765-a58d-4ceed8af9237 service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-unplugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:42 user nova-compute[75071]: WARNING nova.compute.manager [req-14d016d5-7772-4fdc-bdee-4d246713e39f req-6dd4ba70-908c-4765-a58d-4ceed8af9237 service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received unexpected event network-vif-unplugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with vm_state active and task_state rebuilding.
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully updated port: f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:23:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance destroyed successfully.
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-bda0814a-ec11-4f93-93ec-6d58a49e0776. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:23:42 user nova-compute[75071]: INFO nova.compute.manager [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Detaching volume 2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:23:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:42 user nova-compute[75071]: INFO nova.virt.block_device [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Attempting to driver detach volume 2ecf8b34-b51c-497c-b64a-6ad3229a18ef from mountpoint /dev/vdb
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Attempting to detach device vdb from instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:23:42 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:23:42 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:23:42 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:23:42 user nova-compute[75071]:   <serial>2ecf8b34-b51c-497c-b64a-6ad3229a18ef</serial>
Nov 29 13:23:42 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:23:42 user nova-compute[75071]: </disk>
Nov 29 13:23:42 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:23:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully detached device vdb from instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 from the persistent domain config.
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:42 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64029b-59bc-42ee-875a-41153ada45db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:23:42 user nova-compute[75071]: No targets found.
Nov 29 13:23:42 user nova-compute[75071]: iSNS:
Nov 29 13:23:42 user nova-compute[75071]: No targets found.
Nov 29 13:23:42 user nova-compute[75071]: STATIC:
Nov 29 13:23:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:23:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55
Nov 29 13:23:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:23:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:23:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:23:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:42 user nova-compute[75071]: FIRMWARE:
Nov 29 13:23:42 user nova-compute[75071]: No targets found.
Nov 29 13:23:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:23:42 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:23:42 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b7277-ca44-4ae7-8e70-9787134551d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc5ff7bc-01ca-47c3-9b89-135569b4df4a req-5a783aae-c7d9-4bac-a894-f1622625f27c service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b53a2-be47-47af-820f-894d1cc35f9e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:23:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:42 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:23:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e0cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[592149ae-7629-4eca-9c79-3609d398338e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d67cf-85de-42e1-a9c5-ff206f9af640]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d647bc-0393-4ee5-96eb-a3e05ea21370]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dbc52e-5888-442d-954c-8fa5ccea0a86]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5781245-1088-4d4d-98e1-d2b136c69fa1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully updated port: b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b189cdf-b4da-4ee7-b4e5-2fafba994485]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]
Nov 29 13:23:43 user nova-compute[75071]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.
Nov 29 13:23:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d120b7be-998b-4ee2-af73-eed99eb57747]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== disconnect_volume: return (343ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Successfully updated port: 149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance destroyed successfully.
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1695895604',display_name='tempest-ServerActionsTestOtherA-server-625614162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1695895604',id=14,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/BEBsu8SWQyVo+EcpBRy6SlkamoX5CmQ7XusjEdiTF0jfoalIP8ATzoKuWNZR7C/WHWOVQ9RJolPyVo3wBS3c6D10E/7lFvIfa8WcYKX9M3zt4uF7yzhKQCoeIPMhBnw==',key_name='tempest-keypair-1558894449',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dp042j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=05b48a8b-440a-4af0-81fa-d362302c1bb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_vif [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-f7a25def-1380-46fc-9fcc-ced472fdf3ff. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3ce1c68-dc, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f3e6995-2e71-4bca-8628-c7cd15f441b9) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:44 user nova-compute[75071]: INFO os_vif [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc')
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:44 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[358fa60c-c4be-4660-b6c0-78689ed4a69b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:23:44 user nova-compute[75071]: No targets found.
Nov 29 13:23:44 user nova-compute[75071]: iSNS:
Nov 29 13:23:44 user nova-compute[75071]: No targets found.
Nov 29 13:23:44 user nova-compute[75071]: STATIC:
Nov 29 13:23:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:23:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:44 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55
Nov 29 13:23:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:44 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:23:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:44 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:23:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:44 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:44 user nova-compute[75071]: FIRMWARE:
Nov 29 13:23:44 user nova-compute[75071]: No targets found.
Nov 29 13:23:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:23:44 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:23:44 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[697decd7-e0e2-4b4e-9ec9-c0a46c9e0981]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[551766a8-db33-4c02-8103-1ffe6ea0c28a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:44 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:44 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:44 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:44 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:44 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:44 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e51090>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.118s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== disconnect_volume: return (120ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:23:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Deleting instance files /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8_del
Nov 29 13:23:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Deletion of /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8_del complete
Nov 29 13:23:44 user nova-compute[75071]: INFO nova.virt.block_device [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Booting with volume cda981bc-9acd-492b-822f-f092b6df41aa at /dev/vdb
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-5d717a66-a529-4cd8-bff0-01a5a84874f7 req-edc962e2-e9b5-4b80-84b0-c3b30c954cbb service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d717a66-a529-4cd8-bff0-01a5a84874f7 req-edc962e2-e9b5-4b80-84b0-c3b30c954cbb service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d717a66-a529-4cd8-bff0-01a5a84874f7 req-edc962e2-e9b5-4b80-84b0-c3b30c954cbb service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d717a66-a529-4cd8-bff0-01a5a84874f7 req-edc962e2-e9b5-4b80-84b0-c3b30c954cbb service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-5d717a66-a529-4cd8-bff0-01a5a84874f7 req-edc962e2-e9b5-4b80-84b0-c3b30c954cbb service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:44 user nova-compute[75071]: WARNING nova.compute.manager [req-5d717a66-a529-4cd8-bff0-01a5a84874f7 req-edc962e2-e9b5-4b80-84b0-c3b30c954cbb service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received unexpected event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with vm_state active and task_state rebuilding.
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.utils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63cca12-0e5f-4274-8feb-fbecb83cb8b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17f867-2632-4e60-a18d-a190c9f5acab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: INFO nova.virt.block_device [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Booting with volume 2ecf8b34-b51c-497c-b64a-6ad3229a18ef at /dev/vdb
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[783701bb-bc27-4e6a-b352-896199b47d2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a9338-0ca0-4418-8a68-a432b460b962]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.utils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:44 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a6bb25-df81-47e4-8505-831224d4ecdc]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc91e863-4d27-440a-9517-7d60e3472a42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.utils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating existing volume attachment record: d420ab9b-94db-4fca-9790-896b0986ecd7 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c0e079-eae2-424e-b8ab-ebc3c40865a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f442038-8aef-4b68-855b-eca0a0aeaac5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7700f71-5763-44ce-814e-d13658bc5554]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:44 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a1e7cf-680e-4b39-abad-fb8763dfe7ca]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG os_brick.utils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updating existing volume attachment record: 64c27caf-455c-414a-a616-287a02cb4a5d {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance network_info: |[{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updated VIF entry in instance network info cache for port f7a25def-1380-46fc-9fcc-ced472fdf3ff. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updated VIF entry in instance network info cache for port b0ba9e9d-e4ac-4368-8d79-dff472bb46b9. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-149f6e1a-4425-4a14-9c12-2515d0a56efe. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port 149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updated VIF entry in instance network info cache for port 149f6e1a-4425-4a14-9c12-2515d0a56efe. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:47 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:23:47 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:23:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.07830047607422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e1298057-6fff-4242-8699-800455ad57b9 req-d915718b-7a51-4cd9-a7c0-e0a80ffe39d8 service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Applying migration context for instance 6935d835-c98f-4355-8031-4436125925f1 as it has an incoming, in-progress migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d. Migration status is finished {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 13:23:48 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating resource usage from migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d
Nov 29 13:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 014f79bb-e808-49e1-8d7a-c058b99c8377 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 89d407c4-7e0e-4213-a2a2-99d547c42a4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 84b6410e-14ea-49ad-98f0-32933047ba58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.888s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Port 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd binding to destination host user is already ACTIVE {{(pid=75071) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Creating tmpfile /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/tmp5e7duw6i to verify with other compute node that the instance is on the same shared storage. {{(pid=75071) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:49 user nova-compute[75071]: INFO nova.compute.manager [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Unrescuing
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-bfa8c8bd-87ba-478f-8f5b-0d8698e3816f req-eddc0e3c-38e4-44d5-ba20-88018a6583ba service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-unplugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bfa8c8bd-87ba-478f-8f5b-0d8698e3816f req-eddc0e3c-38e4-44d5-ba20-88018a6583ba service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bfa8c8bd-87ba-478f-8f5b-0d8698e3816f req-eddc0e3c-38e4-44d5-ba20-88018a6583ba service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bfa8c8bd-87ba-478f-8f5b-0d8698e3816f req-eddc0e3c-38e4-44d5-ba20-88018a6583ba service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-bfa8c8bd-87ba-478f-8f5b-0d8698e3816f req-eddc0e3c-38e4-44d5-ba20-88018a6583ba service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-unplugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:49 user nova-compute[75071]: WARNING nova.compute.manager [req-bfa8c8bd-87ba-478f-8f5b-0d8698e3816f req-eddc0e3c-38e4-44d5-ba20-88018a6583ba service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-unplugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state resized and task_state resize_reverting.
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'flavor' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance destroyed successfully.
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lazy-loading 'resources' on Instance uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_vif [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10d0cfed-e7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d0184b5-8c39-4f31-987a-d6e30b54a27f) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: INFO os_vif [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7')
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4726809e-0dcd-4fba-8938-a9f5846cc990]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:23:50 user nova-compute[75071]: No targets found.
Nov 29 13:23:50 user nova-compute[75071]: iSNS:
Nov 29 13:23:50 user nova-compute[75071]: No targets found.
Nov 29 13:23:50 user nova-compute[75071]: STATIC:
Nov 29 13:23:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:23:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55
Nov 29 13:23:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:23:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:23:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:23:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:23:50 user nova-compute[75071]: FIRMWARE:
Nov 29 13:23:50 user nova-compute[75071]: No targets found.
Nov 29 13:23:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:23:50 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:23:50 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabc373d-a31c-43a2-affa-c2b3789b4196]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b1962-224a-4554-acca-555d7b5dfffe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:50 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:50 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:50 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:50 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:50 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:23:50 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124ef5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4773d5-0561-4815-ae76-59cd7f68317e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a458251d-51e4-4d4f-8e43-39b8e2632479]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a1b841-6ad8-420a-923b-08d407502bc1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22262f4-f994-4f7d-ba38-ddff9f738afa]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ebf305d-d724-4f27-b3ee-966c6cb5487d req-02e556b6-b180-4a3d-99f4-7e7cff605df7 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ebf305d-d724-4f27-b3ee-966c6cb5487d req-02e556b6-b180-4a3d-99f4-7e7cff605df7 service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ebf305d-d724-4f27-b3ee-966c6cb5487d req-02e556b6-b180-4a3d-99f4-7e7cff605df7 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ebf305d-d724-4f27-b3ee-966c6cb5487d req-02e556b6-b180-4a3d-99f4-7e7cff605df7 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ebf305d-d724-4f27-b3ee-966c6cb5487d req-02e556b6-b180-4a3d-99f4-7e7cff605df7 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:50 user nova-compute[75071]: WARNING nova.compute.manager [req-6ebf305d-d724-4f27-b3ee-966c6cb5487d req-02e556b6-b180-4a3d-99f4-7e7cff605df7 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adba767-c9ee-49d8-97be-a3a8ff1f5961]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[816a6e86-f805-44d4-8f54-3749ef824c37]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]
Nov 29 13:23:50 user nova-compute[75071]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.
Nov 29 13:23:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1fea3d-594b-4450-8f0b-32e8267579ca]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== disconnect_volume: return (403ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing instance network info cache due to event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:50 user nova-compute[75071]: DEBUG nova.network.neutron [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance destroyed successfully.
Nov 29 13:23:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updated VIF entry in instance network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2621b0c4-6328-432a-ae02-1de55cc759ac req-e7da51dd-0769-499a-81dc-1d2bfbb8365f service nova] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lazy-loading 'migration_context' on Instance uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG nova.objects.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Object Instance<6935d835-c98f-4355-8031-4436125925f1> lazy-loaded attributes: resources,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-639d743b-f3e9-49d9-8a5a-b7587a72cd3b req-4071cb25-c2ca-4a46-94c6-38d55ff6a46d service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-639d743b-f3e9-49d9-8a5a-b7587a72cd3b req-4071cb25-c2ca-4a46-94c6-38d55ff6a46d service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-639d743b-f3e9-49d9-8a5a-b7587a72cd3b req-4071cb25-c2ca-4a46-94c6-38d55ff6a46d service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-639d743b-f3e9-49d9-8a5a-b7587a72cd3b req-4071cb25-c2ca-4a46-94c6-38d55ff6a46d service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-639d743b-f3e9-49d9-8a5a-b7587a72cd3b req-4071cb25-c2ca-4a46-94c6-38d55ff6a46d service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:51 user nova-compute[75071]: WARNING nova.compute.manager [req-639d743b-f3e9-49d9-8a5a-b7587a72cd3b req-4071cb25-c2ca-4a46-94c6-38d55ff6a46d service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state resized and task_state resize_reverting.
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.485s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:52 user nova-compute[75071]: INFO nova.compute.manager [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Swapping old allocation on dict_keys(['e517bf91-8e31-44c7-82cf-bb88030161c7']) held by migration 68d46fbe-93ab-4351-aaf4-5df2dd9bee0d for instance
Nov 29 13:23:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Overwriting current allocation {'allocations': {'e517bf91-8e31-44c7-82cf-bb88030161c7': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '42978586ae934e319e9848de833d9877', 'user_id': '41649c13883b4d01a13a22c529f9bc6f', 'consumer_generation': 1} on consumer 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquired lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:52 user nova-compute[75071]: WARNING nova.compute.manager [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:52 user nova-compute[75071]: WARNING nova.compute.manager [req-9ba40023-018b-4fed-bc87-ea35dfecae86 req-c7cc94c4-facf-412c-a483-7e36979f6d6c service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing instance network info cache due to event network-changed-16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] Acquiring lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] Acquired lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:23:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Refreshing network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Releasing lock "refresh_cache-6935d835-c98f-4355-8031-4436125925f1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.utils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca53912-d0a3-4d05-a899-dd24474849fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc50ac4-8d7e-4cef-b6d9-77e2de3c0330]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ac867f-5363-4a90-9cf5-2dba187a91f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b727ebbd-9f10-44c7-bfb7-982f0fc0a1d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:23:53 user nova-compute[75071]: INFO nova.virt.block_device [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Booting with volume c59596be-1f1f-40ad-b2aa-02f5a25a35fb at /dev/vdc
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:53 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8198738-3c12-44b0-8b3d-c928d4bbe257]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.utils [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.utils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:23:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Creating image(s)
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f01ece-770c-4811-baec-bb10acc8211a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[700fc2ce-1f01-454d-9a16-d2c837c73a9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f2700-0f21-4ef2-9c77-459e721f92e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2dd4b0-eacc-4ba9-b614-42bbe7536811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:23:53 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc462a69-f6bd-4358-ae17-d32cecb1c4d7]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG os_brick.utils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating existing volume attachment record: 143d5e87-8be0-4aab-afd4-edd88ec64757 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updated VIF entry in instance network info cache for port 16906a3e-623e-41b2-9940-0d068b2c5625. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [{"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.230s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4776bf39-89fe-420c-b108-305f45f12945 req-ce605e2e-a33c-45e2-ba5b-58c9f48180c3 service nova] Releasing lock "refresh_cache-ef8e7624-0193-4ba9-ae01-0a3a140f7a67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk 1073741824" returned: 0 in 0.049s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Cannot resize image /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Ensure instance console log exists: /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Start _get_guest_xml network_info=[{"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05b48a8b-440a-4af0-81fa-d362302c1bb8', 'attached_at': '', 'detached_at': '', 'volume_id': '2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'serial': '2ecf8b34-b51c-497c-b64a-6ad3229a18ef'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '64c27caf-455c-414a-a616-287a02cb4a5d', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:23:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 13:23:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:23:54 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:54 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:23:54 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1fda44-6817-4f75-9d8a-22d2198d03b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:23:54 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd68b8a-a2dc-47b0-9f7b-dfc4469d6bff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef] added
Nov 29 13:23:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[add9219f-f9dc-4c11-9aaf-d88c79a19605]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b3102b-201e-4be6-a051-ec785e4637d1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRzJxQeh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WRzJxQeh" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab09449-28e3-4a87-80f2-787991c4f72c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WRzJxQeh'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddd5320-17e0-4ceb-8251-19cf9a68a1f3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdb6a20-ffde-4f68-a490-302e7f3382d3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa3e478-de68-433c-9002-8c16b648902d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]
Nov 29 13:23:54 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.
Nov 29 13:23:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72861044-b2fe-4026-8248-3bf77a7f8537]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de46e7b9-c697-47e1-bf58-5f911bbdda78]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:23:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:23:54 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:23:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[93485dc5-b7ee-47de-a642-b174a38c75aa]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-6a2a9d23-d409-480d-a5c5-89c2fb01fcbb req-38f462a6-568f-49dc-ba9a-4afd9e591eb4 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6a2a9d23-d409-480d-a5c5-89c2fb01fcbb req-38f462a6-568f-49dc-ba9a-4afd9e591eb4 service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6a2a9d23-d409-480d-a5c5-89c2fb01fcbb req-38f462a6-568f-49dc-ba9a-4afd9e591eb4 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6a2a9d23-d409-480d-a5c5-89c2fb01fcbb req-38f462a6-568f-49dc-ba9a-4afd9e591eb4 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-6a2a9d23-d409-480d-a5c5-89c2fb01fcbb req-38f462a6-568f-49dc-ba9a-4afd9e591eb4 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:54 user nova-compute[75071]: WARNING nova.compute.manager [req-6a2a9d23-d409-480d-a5c5-89c2fb01fcbb req-38f462a6-568f-49dc-ba9a-4afd9e591eb4 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:23:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1648302e-5677-4224-8833-daa36d194d57 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23865623163616665', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865623163616665', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1695895604',display_name='tempest-ServerActionsTestOtherA-server-625614162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1695895604',id=14,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/BEBsu8SWQyVo+EcpBRy6SlkamoX5CmQ7XusjEdiTF0jfoalIP8ATzoKuWNZR7C/WHWOVQ9RJolPyVo3wBS3c6D10E/7lFvIfa8WcYKX9M3zt4uF7yzhKQCoeIPMhBnw==',key_name='tempest-keypair-1558894449',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dp042j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=05b48a8b-440a-4af0-81fa-d362302c1bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:23:55 user nova-compute[75071]:   <uuid>05b48a8b-440a-4af0-81fa-d362302c1bb8</uuid>
Nov 29 13:23:55 user nova-compute[75071]:   <name>instance-0000000e</name>
Nov 29 13:23:55 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:23:55 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:23:55 user nova-compute[75071]:   <metadata>
Nov 29 13:23:55 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:23:55 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:23:55 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-625614162</nova:name>
Nov 29 13:23:55 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:23:54</nova:creationTime>
Nov 29 13:23:55 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:23:55 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:23:55 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:23:55 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:23:55 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:23:55 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:23:55 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:23:55 user nova-compute[75071]:       <nova:owner>
Nov 29 13:23:55 user nova-compute[75071]:         <nova:user uuid="8395b32f70af4fd782ad81a609e9f63a">tempest-ServerActionsTestOtherA-611751521-project-member</nova:user>
Nov 29 13:23:55 user nova-compute[75071]:         <nova:project uuid="36f5f5e7553949989e7fc90db828a0bd">tempest-ServerActionsTestOtherA-611751521</nova:project>
Nov 29 13:23:55 user nova-compute[75071]:       </nova:owner>
Nov 29 13:23:55 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:23:55 user nova-compute[75071]:       <nova:ports>
Nov 29 13:23:55 user nova-compute[75071]:         <nova:port uuid="b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14">
Nov 29 13:23:55 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:23:55 user nova-compute[75071]:         </nova:port>
Nov 29 13:23:55 user nova-compute[75071]:       </nova:ports>
Nov 29 13:23:55 user nova-compute[75071]:     </nova:instance>
Nov 29 13:23:55 user nova-compute[75071]:   </metadata>
Nov 29 13:23:55 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:23:55 user nova-compute[75071]:     <system>
Nov 29 13:23:55 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:23:55 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:23:55 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:23:55 user nova-compute[75071]:       <entry name="serial">05b48a8b-440a-4af0-81fa-d362302c1bb8</entry>
Nov 29 13:23:55 user nova-compute[75071]:       <entry name="uuid">05b48a8b-440a-4af0-81fa-d362302c1bb8</entry>
Nov 29 13:23:55 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:23:55 user nova-compute[75071]:     </system>
Nov 29 13:23:55 user nova-compute[75071]:   </sysinfo>
Nov 29 13:23:55 user nova-compute[75071]:   <os>
Nov 29 13:23:55 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:23:55 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:23:55 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:23:55 user nova-compute[75071]:   </os>
Nov 29 13:23:55 user nova-compute[75071]:   <features>
Nov 29 13:23:55 user nova-compute[75071]:     <acpi/>
Nov 29 13:23:55 user nova-compute[75071]:     <apic/>
Nov 29 13:23:55 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:23:55 user nova-compute[75071]:   </features>
Nov 29 13:23:55 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:23:55 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:23:55 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:23:55 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:23:55 user nova-compute[75071]:   </clock>
Nov 29 13:23:55 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:23:55 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:23:55 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:23:55 user nova-compute[75071]:   </cpu>
Nov 29 13:23:55 user nova-compute[75071]:   <devices>
Nov 29 13:23:55 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:23:55 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:23:55 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk"/>
Nov 29 13:23:55 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:23:55 user nova-compute[75071]:     </disk>
Nov 29 13:23:55 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:23:55 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:23:55 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Nov 29 13:23:55 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:23:55 user nova-compute[75071]:       <serial>2ecf8b34-b51c-497c-b64a-6ad3229a18ef</serial>
Nov 29 13:23:55 user nova-compute[75071]:     </disk>
Nov 29 13:23:55 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:23:55 user nova-compute[75071]:       <mac address="fa:16:3e:1f:41:4b"/>
Nov 29 13:23:55 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:23:55 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:23:55 user nova-compute[75071]:       <target dev="tapb3ce1c68-dc"/>
Nov 29 13:23:55 user nova-compute[75071]:     </interface>
Nov 29 13:23:55 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:23:55 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/console.log" append="off"/>
Nov 29 13:23:55 user nova-compute[75071]:     </serial>
Nov 29 13:23:55 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:23:55 user nova-compute[75071]:     <video>
Nov 29 13:23:55 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:23:55 user nova-compute[75071]:     </video>
Nov 29 13:23:55 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:23:55 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:23:55 user nova-compute[75071]:     </rng>
Nov 29 13:23:55 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:23:55 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:23:55 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:23:55 user nova-compute[75071]:     </memballoon>
Nov 29 13:23:55 user nova-compute[75071]:   </devices>
Nov 29 13:23:55 user nova-compute[75071]: </domain>
Nov 29 13:23:55 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1695895604',display_name='tempest-ServerActionsTestOtherA-server-625614162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1695895604',id=14,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/BEBsu8SWQyVo+EcpBRy6SlkamoX5CmQ7XusjEdiTF0jfoalIP8ATzoKuWNZR7C/WHWOVQ9RJolPyVo3wBS3c6D10E/7lFvIfa8WcYKX9M3zt4uF7yzhKQCoeIPMhBnw==',key_name='tempest-keypair-1558894449',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dp042j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=05b48a8b-440a-4af0-81fa-d362302c1bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG os_vif [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '751e78fe-e955-5a69-999a-213b10cc3f66', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3ce1c68-dc, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3ce1c68-dc, col_values=(('qos', UUID('f9ef7eef-bc49-4e7f-8a1e-b08ccd789be4')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3ce1c68-dc, col_values=(('external_ids', {'iface-id': 'b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:41:4b', 'vm-uuid': '05b48a8b-440a-4af0-81fa-d362302c1bb8'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:55 user nova-compute[75071]: INFO os_vif [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc')
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:23:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No VIF found with MAC fa:16:3e:1f:41:4b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-f566409d-59e8-4555-9755-a5cfaacd9954 req-3b5dbe40-fed8-4682-9007-e73e34207c3d service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f566409d-59e8-4555-9755-a5cfaacd9954 req-3b5dbe40-fed8-4682-9007-e73e34207c3d service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f566409d-59e8-4555-9755-a5cfaacd9954 req-3b5dbe40-fed8-4682-9007-e73e34207c3d service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f566409d-59e8-4555-9755-a5cfaacd9954 req-3b5dbe40-fed8-4682-9007-e73e34207c3d service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-f566409d-59e8-4555-9755-a5cfaacd9954 req-3b5dbe40-fed8-4682-9007-e73e34207c3d service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:57 user nova-compute[75071]: WARNING nova.compute.manager [req-f566409d-59e8-4555-9755-a5cfaacd9954 req-3b5dbe40-fed8-4682-9007-e73e34207c3d service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received unexpected event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 13:23:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-9776054e-a897-491f-9479-77e771259b99 req-320af31e-2ef4-4e8a-bfee-4de5df4420ab service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9776054e-a897-491f-9479-77e771259b99 req-320af31e-2ef4-4e8a-bfee-4de5df4420ab service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9776054e-a897-491f-9479-77e771259b99 req-320af31e-2ef4-4e8a-bfee-4de5df4420ab service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9776054e-a897-491f-9479-77e771259b99 req-320af31e-2ef4-4e8a-bfee-4de5df4420ab service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-9776054e-a897-491f-9479-77e771259b99 req-320af31e-2ef4-4e8a-bfee-4de5df4420ab service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:23:59 user nova-compute[75071]: WARNING nova.compute.manager [req-9776054e-a897-491f-9479-77e771259b99 req-320af31e-2ef4-4e8a-bfee-4de5df4420ab service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received unexpected event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:23:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance spawned successfully.
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:23:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75071) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40924813-aca3-4d71-8f8c-68a9962e0b25 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:00 user nova-compute[75071]: INFO nova.compute.manager [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Terminating instance
Nov 29 13:24:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:24:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Instance destroyed successfully.
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lazy-loading 'resources' on Instance uuid 014f79bb-e808-49e1-8d7a-c058b99c8377 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:18:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1007830647',display_name='tempest-VolumesAdminNegativeTest-server-1007830647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1007830647',id=5,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+LEi5qfq4YrHJ+PYJQ+dwUUlnkNDODawaledfmjtPqxl4XU3QhWGLBG7fLBRUTnshPNfK+aanBgiuYpcu+OcSoJw8FE2qIi2Jv3q4kmvhNBjXuNHx5Y9WQzmvGn8zGrA==',key_name='tempest-keypair-458538850',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5c2c9d59234462091e0e4548c770d12',ramdisk_id='',reservation_id='r-34600hat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-984213226',owner_user_name='tempest-VolumesAdminNegativeTest-984213226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44500d2105a742ddacaf6e766f042bf2',uuid=014f79bb-e808-49e1-8d7a-c058b99c8377,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converting VIF {"id": "cf16aa7f-bd3e-4107-850f-37bae039432d", "address": "fa:16:3e:20:58:16", "network": {"id": "c29dbc7f-64d1-43ae-8ae8-9880f463be85", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1203324468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5c2c9d59234462091e0e4548c770d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf16aa7f-bd", "ovs_interfaceid": "cf16aa7f-bd3e-4107-850f-37bae039432d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:58:16,bridge_name='br-int',has_traffic_filtering=True,id=cf16aa7f-bd3e-4107-850f-37bae039432d,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf16aa7f-bd') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG os_vif [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:58:16,bridge_name='br-int',has_traffic_filtering=True,id=cf16aa7f-bd3e-4107-850f-37bae039432d,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf16aa7f-bd') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf16aa7f-bd, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e968f760-edcd-4e91-b89f-fcc67be8afe8) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:01 user nova-compute[75071]: INFO os_vif [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:58:16,bridge_name='br-int',has_traffic_filtering=True,id=cf16aa7f-bd3e-4107-850f-37bae039432d,network=Network(c29dbc7f-64d1-43ae-8ae8-9880f463be85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf16aa7f-bd')
Nov 29 13:24:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Deleting instance files /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377_del
Nov 29 13:24:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Deletion of /opt/stack/data/nova/instances/014f79bb-e808-49e1-8d7a-c058b99c8377_del complete
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-vif-unplugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] No waiting events found dispatching network-vif-unplugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-vif-unplugged-cf16aa7f-bd3e-4107-850f-37bae039432d for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] Acquiring lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] No waiting events found dispatching network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:01 user nova-compute[75071]: WARNING nova.compute.manager [req-65a6b10a-ebd0-4992-95a7-11985e8d5224 req-6dd6b67c-b39f-443c-8c80-cfb942ac96b4 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received unexpected event network-vif-plugged-cf16aa7f-bd3e-4107-850f-37bae039432d for instance with vm_state active and task_state deleting.
Nov 29 13:24:01 user nova-compute[75071]: INFO nova.compute.manager [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 13:24:01 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:24:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Starting finish_revert_migration {{(pid=75071) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Start _get_guest_xml network_info=[{"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6935d835-c98f-4355-8031-4436125925f1', 'attached_at': '2023-11-29T13:24:02.000000', 'detached_at': '', 'volume_id': '789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'serial': '789d9c7e-beb3-4dd9-9a2d-f47aaf07474a'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'be9189a8-6407-465f-b49b-bf59a0fc975c', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:24:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:02 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[62904eaa-96eb-45ae-b003-6b76f584e76d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:24:02 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6219af-21a8-4baf-bdd5-9287d34b37d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a] added
Nov 29 13:24:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9379dfbb-f991-4a56-ad8c-01fd16487e83]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[359fa25c-5c58-4dbc-881e-fff285ee5582]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYSqnbVO {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:24:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Creating image(s)
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Ensure instance console log exists: /opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Start _get_guest_xml network_info=[{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvYUPSLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84b6410e-14ea-49ad-98f0-32933047ba58', 'attached_at': '', 'detached_at': '', 'volume_id': 'caccff51-1c91-429a-83a0-b0be3d846504', 'serial': 'caccff51-1c91-429a-83a0-b0be3d846504'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1f8ce4dc-99d6-46e6-a8e8-895d2ebdcb4c', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OITiLtgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84b6410e-14ea-49ad-98f0-32933047ba58', 'attached_at': '', 'detached_at': '', 'volume_id': 'cda981bc-9acd-492b-822f-f092b6df41aa', 'serial': 'cda981bc-9acd-492b-822f-f092b6df41aa'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'attachment_id': 'd420ab9b-94db-4fca-9790-896b0986ecd7', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSLoPCxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84b6410e-14ea-49ad-98f0-32933047ba58', 'attached_at': '', 'detached_at': '', 'volume_id': 'c59596be-1f1f-40ad-b2aa-02f5a25a35fb', 'serial': 'c59596be-1f1f-40ad-b2aa-02f5a25a35fb'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '143d5e87-8be0-4aab-afd4-edd88ec64757', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYSqnbVO" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfee1fe5-afc4-48db-b905-6df40f09147d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZYSqnbVO'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvYUPSLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.049s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58bb7a8-53b2-4ac5-b8d5-27dae64c7ad7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing instance network info cache due to event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] Acquiring lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] Acquired lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[affb167c-4bf0-4b56-b6d2-e3fae1fdc4b4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[96738869-080f-4cb6-898d-92ff59e3dc2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]
Nov 29 13:24:02 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.
Nov 29 13:24:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29b4cfd-cac9-4c68-bcda-d39c1802f992]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5345a3-e5c8-48aa-81b6-7616523e3f07]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:02 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.048s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b03824-7d7b-44c5-955d-8c2b6e1a3960]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updated VIF entry in instance network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4dec3981-1cca-4ab5-ba79-4cc720dc60a3 req-d6b1ee0d-187c-499e-852b-d18af8ff604f service nova] Releasing lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:03 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Took 1.30 seconds to deallocate network for instance.
Nov 29 13:24:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ddcdf3a-095f-4ee7-b972-112a5adb768a req-3c03816f-35a3-4a84-8c8c-3e2b21e98696 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Received event network-vif-deleted-cf16aa7f-bd3e-4107-850f-37bae039432d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:03 user nova-compute[75071]: INFO nova.compute.manager [req-6ddcdf3a-095f-4ee7-b972-112a5adb768a req-3c03816f-35a3-4a84-8c8c-3e2b21e98696 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Neutron deleted interface cf16aa7f-bd3e-4107-850f-37bae039432d; detaching it from the instance and deleting it from the info cache
Nov 29 13:24:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-6ddcdf3a-095f-4ee7-b972-112a5adb768a req-3c03816f-35a3-4a84-8c8c-3e2b21e98696 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ddcdf3a-095f-4ee7-b972-112a5adb768a req-3c03816f-35a3-4a84-8c8c-3e2b21e98696 service nova] [instance: 014f79bb-e808-49e1-8d7a-c058b99c8377] Detach interface failed, port_id=cf16aa7f-bd3e-4107-850f-37bae039432d, reason: Instance 014f79bb-e808-49e1-8d7a-c058b99c8377 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26464613365623430', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464613365623430', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.263s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:03 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.727s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e3a01c-1703-4c01-8418-675920d7f978]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:24:03 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:03 user nova-compute[75071]: INFO nova.compute.manager [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Detaching volume 883dbcb6-4f9d-4469-ab00-47c241d1ef55
Nov 29 13:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85081444-0ce2-4357-90c0-a718faca10e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504] added
Nov 29 13:24:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Deleted allocations for instance 014f79bb-e808-49e1-8d7a-c058b99c8377
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:24:04 user nova-compute[75071]:   <uuid>6935d835-c98f-4355-8031-4436125925f1</uuid>
Nov 29 13:24:04 user nova-compute[75071]:   <name>instance-00000003</name>
Nov 29 13:24:04 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:24:04 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:24:04 user nova-compute[75071]:   <metadata>
Nov 29 13:24:04 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:24:04 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:24:04 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherB-server-2016764760</nova:name>
Nov 29 13:24:04 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:24:02</nova:creationTime>
Nov 29 13:24:04 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:24:04 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:24:04 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:24:04 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:24:04 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:24:04 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:24:04 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:24:04 user nova-compute[75071]:       <nova:owner>
Nov 29 13:24:04 user nova-compute[75071]:         <nova:user uuid="41649c13883b4d01a13a22c529f9bc6f">tempest-ServerActionsTestOtherB-1138605091-project-member</nova:user>
Nov 29 13:24:04 user nova-compute[75071]:         <nova:project uuid="42978586ae934e319e9848de833d9877">tempest-ServerActionsTestOtherB-1138605091</nova:project>
Nov 29 13:24:04 user nova-compute[75071]:       </nova:owner>
Nov 29 13:24:04 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:24:04 user nova-compute[75071]:       <nova:ports>
Nov 29 13:24:04 user nova-compute[75071]:         <nova:port uuid="10d0cfed-e70a-4d6e-b80c-75e2376fc0cd">
Nov 29 13:24:04 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:24:04 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:04 user nova-compute[75071]:       </nova:ports>
Nov 29 13:24:04 user nova-compute[75071]:     </nova:instance>
Nov 29 13:24:04 user nova-compute[75071]:   </metadata>
Nov 29 13:24:04 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:24:04 user nova-compute[75071]:     <system>
Nov 29 13:24:04 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:24:04 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:24:04 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:24:04 user nova-compute[75071]:       <entry name="serial">6935d835-c98f-4355-8031-4436125925f1</entry>
Nov 29 13:24:04 user nova-compute[75071]:       <entry name="uuid">6935d835-c98f-4355-8031-4436125925f1</entry>
Nov 29 13:24:04 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:24:04 user nova-compute[75071]:     </system>
Nov 29 13:24:04 user nova-compute[75071]:   </sysinfo>
Nov 29 13:24:04 user nova-compute[75071]:   <os>
Nov 29 13:24:04 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:24:04 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:24:04 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:24:04 user nova-compute[75071]:   </os>
Nov 29 13:24:04 user nova-compute[75071]:   <features>
Nov 29 13:24:04 user nova-compute[75071]:     <acpi/>
Nov 29 13:24:04 user nova-compute[75071]:     <apic/>
Nov 29 13:24:04 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:24:04 user nova-compute[75071]:   </features>
Nov 29 13:24:04 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:24:04 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:24:04 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:24:04 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:24:04 user nova-compute[75071]:   </clock>
Nov 29 13:24:04 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:24:04 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:24:04 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:24:04 user nova-compute[75071]:   </cpu>
Nov 29 13:24:04 user nova-compute[75071]:   <devices>
Nov 29 13:24:04 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:24:04 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:24:04 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk"/>
Nov 29 13:24:04 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:24:04 user nova-compute[75071]:     </disk>
Nov 29 13:24:04 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:24:04 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:04 user nova-compute[75071]:       <source dev="/dev/sdf"/>
Nov 29 13:24:04 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:24:04 user nova-compute[75071]:       <serial>789d9c7e-beb3-4dd9-9a2d-f47aaf07474a</serial>
Nov 29 13:24:04 user nova-compute[75071]:     </disk>
Nov 29 13:24:04 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:04 user nova-compute[75071]:       <mac address="fa:16:3e:92:79:29"/>
Nov 29 13:24:04 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:04 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:04 user nova-compute[75071]:       <target dev="tap10d0cfed-e7"/>
Nov 29 13:24:04 user nova-compute[75071]:     </interface>
Nov 29 13:24:04 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:24:04 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/console.log" append="off"/>
Nov 29 13:24:04 user nova-compute[75071]:     </serial>
Nov 29 13:24:04 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:24:04 user nova-compute[75071]:     <video>
Nov 29 13:24:04 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:04 user nova-compute[75071]:     </video>
Nov 29 13:24:04 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:24:04 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:24:04 user nova-compute[75071]:     </rng>
Nov 29 13:24:04 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:24:04 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:24:04 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:24:04 user nova-compute[75071]:     </memballoon>
Nov 29 13:24:04 user nova-compute[75071]:   </devices>
Nov 29 13:24:04 user nova-compute[75071]: </domain>
Nov 29 13:24:04 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_vif [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[899dc49f-8ff8-4c52-bb90-fc5c27063817]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f77593a-61a7-51c1-bca4-88476bae037b', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10d0cfed-e7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10d0cfed-e7, col_values=(('qos', UUID('041ad235-12c1-4dcc-b2a8-daea73a06fab')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10d0cfed-e7, col_values=(('external_ids', {'iface-id': '10d0cfed-e70a-4d6e-b80c-75e2376fc0cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:79:29', 'vm-uuid': '6935d835-c98f-4355-8031-4436125925f1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:04 user nova-compute[75071]: INFO os_vif [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7')
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf0d8e6-ee6a-44f6-a89b-c5a5d8fc2b2b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvYUPSLt {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvYUPSLt" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c0707-d482-4d8a-8171-1d2f3adb22c6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wvYUPSLt'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d057d63-0769-4e83-ada7-257729061051]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: INFO nova.virt.block_device [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Attempting to driver detach volume 883dbcb6-4f9d-4469-ab00-47c241d1ef55 from mountpoint /dev/vdb
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad371b03-add8-4410-adaf-04bcce8f6019]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Attempting to detach device vdb from instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:24:04 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:04 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:24:04 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:24:04 user nova-compute[75071]:   <serial>883dbcb6-4f9d-4469-ab00-47c241d1ef55</serial>
Nov 29 13:24:04 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:24:04 user nova-compute[75071]: </disk>
Nov 29 13:24:04 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3025fcbf-98ba-47e8-baeb-376393fcd701 tempest-VolumesAdminNegativeTest-984213226 tempest-VolumesAdminNegativeTest-984213226-project-member] Lock "014f79bb-e808-49e1-8d7a-c058b99c8377" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.363s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully detached device vdb from instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c from the persistent domain config.
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:24:04 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:04 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:24:04 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:24:04 user nova-compute[75071]:   <serial>883dbcb6-4f9d-4469-ab00-47c241d1ef55</serial>
Nov 29 13:24:04 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:24:04 user nova-compute[75071]: </disk>
Nov 29 13:24:04 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc256d-d5f4-4eb9-befc-f67652825c5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260]
Nov 29 13:24:04 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260] successful.
Nov 29 13:24:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a0193d-27b2-4bec-b1a4-f8c345d436e9]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71124862-cd01-475f-85d1-ea17815e716d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:04 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.777s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfb0101-42dd-406d-9f1f-ce71834d2ac3]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvYUPSLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing instance network info cache due to event network-changed-fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] Acquiring lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] Acquired lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Refreshing network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updated VIF entry in instance network info cache for port fc66d61b-df87-483c-96a1-89033c9deaa8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:24:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [{"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd80e76f-1489-4444-8e0f-0ccde9d384bc req-0055eac1-2cca-4b8b-8f7d-7c23caaffba2 service nova] Releasing lock "refresh_cache-f7c9047c-00f3-4cb3-9290-6d118bda1c9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.824s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== connect_volume: return (3087ms) {'type': 'block', 'scsi_wwn': '23665333662303637', 'path': '/dev/sdg'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665333662303637', 'path': '/dev/sdg'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OITiLtgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:05 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:05 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:05 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a27fbf3-4db9-4999-9eb7-7701f82c6b75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:24:05 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c238e1-42ae-4dcc-9eb2-f3209f7b1be2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa] added
Nov 29 13:24:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f35107-0517-4d5d-93b4-ad04bf0332b1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71c3c29-8986-4198-b9a7-ff2e0d0627ff]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OITiLtgG {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OITiLtgG" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bef98a-8df6-4527-b9af-94e7898c48e1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OITiLtgG'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e100c551-8183-4475-b06c-c3836125ce21]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a45d23-5035-47cb-87d9-0b3f41144587]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbcce03-fa3c-42e6-9b37-7777fad3b5be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260]
Nov 29 13:24:05 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260] successful.
Nov 29 13:24:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e33d2b-59a5-4349-bf36-f1b7c3d634c1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6607a0-db5b-4169-bc33-32a8f965709a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:05 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6043abe-5224-40ad-88ae-b0d803fc814c]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OITiLtgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:06 user nova-compute[75071]: WARNING nova.compute.manager [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state resized and task_state resize_reverting.
Nov 29 13:24:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] No waiting events found dispatching network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:06 user nova-compute[75071]: WARNING nova.compute.manager [req-95b63f18-243f-4abb-8e93-b1991739ab3a req-23573e86-359b-4cca-a576-4fc7569ca97f service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received unexpected event network-vif-plugged-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd for instance with vm_state resized and task_state resize_reverting.
Nov 29 13:24:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26636346163663966', 'path': '/dev/sdh'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636346163663966', 'path': '/dev/sdh'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSLoPCxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:06 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:06 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:06 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8520bd-2a7b-479f-86fe-b88c8a85ff81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:24:06 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb3fbb9-ac66-4115-8666-9c979f3db25c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb] added
Nov 29 13:24:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be018ce4-84c1-434d-8776-22239cba670f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea33e584-eb01-434c-a2d7-454024969033]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSLoPCxX {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lSLoPCxX" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e17ce45-3498-4254-91c5-20dd79163e14]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lSLoPCxX'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa61a049-6f3f-4efe-bd23-2d8075eb04fb]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab916c2-e60a-4451-bb17-302e58c61d71]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:06 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4573235-5632-4cb0-aa85-30001bfd1993]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260]
Nov 29 13:24:07 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260] successful.
Nov 29 13:24:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f974e-a1f3-4ad5-bff5-7e4784c42855]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a38bff-dce4-4223-9a2a-c399458a2073]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:07 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] HCTL ('40', '-', '-', 0) found on session 23 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ab08c6-05a7-4c80-b9e6-1ef4fc37a40e]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Searching for a device in session 23 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:24:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSLoPCxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:24:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance running successfully.
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] finish_revert_migration finished successfully. {{(pid=75071) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26532643536646661', 'path': '/dev/sdi'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532643536646661', 'path': '/dev/sdi'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=12a2c809-c585-4ef3-b1ce-17bd3df2bbbd,network=Network(a76d1c25-afe7-49b0-bd21-fa2ac6d26784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a2c809-c5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:71,bridge_name='br-int',has_traffic_filtering=True,id=4b2e7ffe-9534-4809-9de9-63a997b0da9a,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b2e7ffe-95') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=2ddafa0f-75cc-434f-8a5f-164201102d76,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ddafa0f-75') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:0a:e7,bridge_name='br-int',has_traffic_filtering=True,id=bda0814a-ec11-4f93-93ec-6d58a49e0776,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbda0814a-ec') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:df:11,bridge_name='br-int',has_traffic_filtering=True,id=f7a25def-1380-46fc-9fcc-ced472fdf3ff,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7a25def-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:57:76,bridge_name='br-int',has_traffic_filtering=True,id=b0ba9e9d-e4ac-4368-8d79-dff472bb46b9,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ba9e9d-e4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:f0:31,bridge_name='br-int',has_traffic_filtering=True,id=149f6e1a-4425-4a14-9c12-2515d0a56efe,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149f6e1a-44') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b6410e-14ea-49ad-98f0-32933047ba58 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:24:08 user nova-compute[75071]:   <uuid>84b6410e-14ea-49ad-98f0-32933047ba58</uuid>
Nov 29 13:24:08 user nova-compute[75071]:   <name>instance-00000012</name>
Nov 29 13:24:08 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:24:08 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:24:08 user nova-compute[75071]:   <metadata>
Nov 29 13:24:08 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:24:08 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:24:08 user nova-compute[75071]:       <nova:name>tempest-device-tagging-server-1920304205</nova:name>
Nov 29 13:24:08 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:24:02</nova:creationTime>
Nov 29 13:24:08 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:24:08 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:24:08 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:24:08 user nova-compute[75071]:       <nova:owner>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:user uuid="033f984ade194139a635d47665a80928">tempest-TaggedBootDevicesTest_v242-983743977-project-member</nova:user>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:project uuid="d6d76574df8c4c1e975d3d75bcefe011">tempest-TaggedBootDevicesTest_v242-983743977</nova:project>
Nov 29 13:24:08 user nova-compute[75071]:       </nova:owner>
Nov 29 13:24:08 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:24:08 user nova-compute[75071]:       <nova:ports>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:port uuid="12a2c809-c585-4ef3-b1ce-17bd3df2bbbd">
Nov 29 13:24:08 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 13:24:08 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:port uuid="4b2e7ffe-9534-4809-9de9-63a997b0da9a">
Nov 29 13:24:08 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Nov 29 13:24:08 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:port uuid="2ddafa0f-75cc-434f-8a5f-164201102d76">
Nov 29 13:24:08 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Nov 29 13:24:08 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:port uuid="bda0814a-ec11-4f93-93ec-6d58a49e0776">
Nov 29 13:24:08 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Nov 29 13:24:08 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:port uuid="f7a25def-1380-46fc-9fcc-ced472fdf3ff">
Nov 29 13:24:08 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Nov 29 13:24:08 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:port uuid="b0ba9e9d-e4ac-4368-8d79-dff472bb46b9">
Nov 29 13:24:08 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 13:24:08 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:08 user nova-compute[75071]:         <nova:port uuid="149f6e1a-4425-4a14-9c12-2515d0a56efe">
Nov 29 13:24:08 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 13:24:08 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:08 user nova-compute[75071]:       </nova:ports>
Nov 29 13:24:08 user nova-compute[75071]:     </nova:instance>
Nov 29 13:24:08 user nova-compute[75071]:   </metadata>
Nov 29 13:24:08 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:24:08 user nova-compute[75071]:     <system>
Nov 29 13:24:08 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:24:08 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:24:08 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:24:08 user nova-compute[75071]:       <entry name="serial">84b6410e-14ea-49ad-98f0-32933047ba58</entry>
Nov 29 13:24:08 user nova-compute[75071]:       <entry name="uuid">84b6410e-14ea-49ad-98f0-32933047ba58</entry>
Nov 29 13:24:08 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:24:08 user nova-compute[75071]:     </system>
Nov 29 13:24:08 user nova-compute[75071]:   </sysinfo>
Nov 29 13:24:08 user nova-compute[75071]:   <os>
Nov 29 13:24:08 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:24:08 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:24:08 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:24:08 user nova-compute[75071]:   </os>
Nov 29 13:24:08 user nova-compute[75071]:   <features>
Nov 29 13:24:08 user nova-compute[75071]:     <acpi/>
Nov 29 13:24:08 user nova-compute[75071]:     <apic/>
Nov 29 13:24:08 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:24:08 user nova-compute[75071]:   </features>
Nov 29 13:24:08 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:24:08 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:24:08 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:24:08 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:24:08 user nova-compute[75071]:   </clock>
Nov 29 13:24:08 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:24:08 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:24:08 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:24:08 user nova-compute[75071]:   </cpu>
Nov 29 13:24:08 user nova-compute[75071]:   <devices>
Nov 29 13:24:08 user nova-compute[75071]:     <disk type="file" device="cdrom">
Nov 29 13:24:08 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 13:24:08 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58/disk.config"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="hda" bus="ide"/>
Nov 29 13:24:08 user nova-compute[75071]:     </disk>
Nov 29 13:24:08 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:24:08 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:08 user nova-compute[75071]:       <source dev="/dev/sdg"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <serial>caccff51-1c91-429a-83a0-b0be3d846504</serial>
Nov 29 13:24:08 user nova-compute[75071]:     </disk>
Nov 29 13:24:08 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:24:08 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:08 user nova-compute[75071]:       <source dev="/dev/sdh"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <serial>cda981bc-9acd-492b-822f-f092b6df41aa</serial>
Nov 29 13:24:08 user nova-compute[75071]:     </disk>
Nov 29 13:24:08 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:24:08 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:08 user nova-compute[75071]:       <source dev="/dev/sdi"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <serial>c59596be-1f1f-40ad-b2aa-02f5a25a35fb</serial>
Nov 29 13:24:08 user nova-compute[75071]:     </disk>
Nov 29 13:24:08 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:08 user nova-compute[75071]:       <mac address="fa:16:3e:e7:e3:db"/>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="tap12a2c809-c5"/>
Nov 29 13:24:08 user nova-compute[75071]:     </interface>
Nov 29 13:24:08 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:08 user nova-compute[75071]:       <mac address="fa:16:3e:7d:47:71"/>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="tap4b2e7ffe-95"/>
Nov 29 13:24:08 user nova-compute[75071]:     </interface>
Nov 29 13:24:08 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:08 user nova-compute[75071]:       <mac address="fa:16:3e:77:cb:70"/>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="tap2ddafa0f-75"/>
Nov 29 13:24:08 user nova-compute[75071]:     </interface>
Nov 29 13:24:08 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:08 user nova-compute[75071]:       <mac address="fa:16:3e:24:0a:e7"/>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="tapbda0814a-ec"/>
Nov 29 13:24:08 user nova-compute[75071]:     </interface>
Nov 29 13:24:08 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:08 user nova-compute[75071]:       <mac address="fa:16:3e:09:df:11"/>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="tapf7a25def-13"/>
Nov 29 13:24:08 user nova-compute[75071]:     </interface>
Nov 29 13:24:08 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:08 user nova-compute[75071]:       <mac address="fa:16:3e:16:57:76"/>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="tapb0ba9e9d-e4"/>
Nov 29 13:24:08 user nova-compute[75071]:     </interface>
Nov 29 13:24:08 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:08 user nova-compute[75071]:       <mac address="fa:16:3e:78:f0:31"/>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:08 user nova-compute[75071]:       <target dev="tap149f6e1a-44"/>
Nov 29 13:24:08 user nova-compute[75071]:     </interface>
Nov 29 13:24:08 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:24:08 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58/console.log" append="off"/>
Nov 29 13:24:08 user nova-compute[75071]:     </serial>
Nov 29 13:24:08 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:24:08 user nova-compute[75071]:     <video>
Nov 29 13:24:08 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:08 user nova-compute[75071]:     </video>
Nov 29 13:24:08 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:24:08 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:24:08 user nova-compute[75071]:     </rng>
Nov 29 13:24:08 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:24:08 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:24:08 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:24:08 user nova-compute[75071]:     </memballoon>
Nov 29 13:24:08 user nova-compute[75071]:   </devices>
Nov 29 13:24:08 user nova-compute[75071]: </domain>
Nov 29 13:24:08 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=12a2c809-c585-4ef3-b1ce-17bd3df2bbbd,network=Network(a76d1c25-afe7-49b0-bd21-fa2ac6d26784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a2c809-c5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=12a2c809-c585-4ef3-b1ce-17bd3df2bbbd,network=Network(a76d1c25-afe7-49b0-bd21-fa2ac6d26784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a2c809-c5') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a515b580-6b31-5329-929e-2f97677a73fa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12a2c809-c5, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12a2c809-c5, col_values=(('qos', UUID('b758468c-fe1a-4442-b435-2801c7292f88')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12a2c809-c5, col_values=(('external_ids', {'iface-id': '12a2c809-c585-4ef3-b1ce-17bd3df2bbbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:e3:db', 'vm-uuid': '84b6410e-14ea-49ad-98f0-32933047ba58'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: INFO os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=12a2c809-c585-4ef3-b1ce-17bd3df2bbbd,network=Network(a76d1c25-afe7-49b0-bd21-fa2ac6d26784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a2c809-c5')
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:71,bridge_name='br-int',has_traffic_filtering=True,id=4b2e7ffe-9534-4809-9de9-63a997b0da9a,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b2e7ffe-95') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:71,bridge_name='br-int',has_traffic_filtering=True,id=4b2e7ffe-9534-4809-9de9-63a997b0da9a,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b2e7ffe-95') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc02b992-0102-513b-aafd-3996f4212bda', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b2e7ffe-95, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b2e7ffe-95, col_values=(('qos', UUID('a74b2394-9eab-4c50-a60f-9d11c166c43a')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b2e7ffe-95, col_values=(('external_ids', {'iface-id': '4b2e7ffe-9534-4809-9de9-63a997b0da9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:47:71', 'vm-uuid': '84b6410e-14ea-49ad-98f0-32933047ba58'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: INFO os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:71,bridge_name='br-int',has_traffic_filtering=True,id=4b2e7ffe-9534-4809-9de9-63a997b0da9a,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b2e7ffe-95')
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=2ddafa0f-75cc-434f-8a5f-164201102d76,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ddafa0f-75') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=2ddafa0f-75cc-434f-8a5f-164201102d76,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ddafa0f-75') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:08 user nova-compute[75071]: INFO nova.compute.manager [None req-2fac6b6f-0370-4cb6-aafa-1a00185261f9 tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance to original state: 'active'
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcc587b3-4e3d-5ee7-809e-d4270ff72cca', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ddafa0f-75, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ddafa0f-75, col_values=(('qos', UUID('8c5b4db4-c62e-4b77-a757-77d491659750')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ddafa0f-75, col_values=(('external_ids', {'iface-id': '2ddafa0f-75cc-434f-8a5f-164201102d76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:cb:70', 'vm-uuid': '84b6410e-14ea-49ad-98f0-32933047ba58'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: INFO os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=2ddafa0f-75cc-434f-8a5f-164201102d76,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ddafa0f-75')
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:0a:e7,bridge_name='br-int',has_traffic_filtering=True,id=bda0814a-ec11-4f93-93ec-6d58a49e0776,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbda0814a-ec') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:0a:e7,bridge_name='br-int',has_traffic_filtering=True,id=bda0814a-ec11-4f93-93ec-6d58a49e0776,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbda0814a-ec') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b008828-d616-574e-a2e3-dc23457c6f22', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbda0814a-ec, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbda0814a-ec, col_values=(('qos', UUID('4c8e5022-36d9-4008-b0d4-e9dd912b4023')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbda0814a-ec, col_values=(('external_ids', {'iface-id': 'bda0814a-ec11-4f93-93ec-6d58a49e0776', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:0a:e7', 'vm-uuid': '84b6410e-14ea-49ad-98f0-32933047ba58'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: INFO os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:0a:e7,bridge_name='br-int',has_traffic_filtering=True,id=bda0814a-ec11-4f93-93ec-6d58a49e0776,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbda0814a-ec')
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:df:11,bridge_name='br-int',has_traffic_filtering=True,id=f7a25def-1380-46fc-9fcc-ced472fdf3ff,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7a25def-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:df:11,bridge_name='br-int',has_traffic_filtering=True,id=f7a25def-1380-46fc-9fcc-ced472fdf3ff,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7a25def-13') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0288724-caea-5811-8308-59c3a78620d5', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7a25def-13, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7a25def-13, col_values=(('qos', UUID('4de89e8d-0e36-4e75-a467-240a4a2365b1')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7a25def-13, col_values=(('external_ids', {'iface-id': 'f7a25def-1380-46fc-9fcc-ced472fdf3ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:df:11', 'vm-uuid': '84b6410e-14ea-49ad-98f0-32933047ba58'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: INFO os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:df:11,bridge_name='br-int',has_traffic_filtering=True,id=f7a25def-1380-46fc-9fcc-ced472fdf3ff,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7a25def-13')
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:57:76,bridge_name='br-int',has_traffic_filtering=True,id=b0ba9e9d-e4ac-4368-8d79-dff472bb46b9,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ba9e9d-e4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:57:76,bridge_name='br-int',has_traffic_filtering=True,id=b0ba9e9d-e4ac-4368-8d79-dff472bb46b9,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ba9e9d-e4') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ebc8916-1dde-5346-98a5-09fada315f94', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0ba9e9d-e4, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0ba9e9d-e4, col_values=(('qos', UUID('11c0b327-dc3f-42e4-8f6d-9a1229cf77fb')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0ba9e9d-e4, col_values=(('external_ids', {'iface-id': 'b0ba9e9d-e4ac-4368-8d79-dff472bb46b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:57:76', 'vm-uuid': '84b6410e-14ea-49ad-98f0-32933047ba58'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: INFO os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:57:76,bridge_name='br-int',has_traffic_filtering=True,id=b0ba9e9d-e4ac-4368-8d79-dff472bb46b9,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ba9e9d-e4')
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:f0:31,bridge_name='br-int',has_traffic_filtering=True,id=149f6e1a-4425-4a14-9c12-2515d0a56efe,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149f6e1a-44') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f0:31,bridge_name='br-int',has_traffic_filtering=True,id=149f6e1a-4425-4a14-9c12-2515d0a56efe,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149f6e1a-44') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45144c45-2390-52be-8605-033c3aed0e92', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap149f6e1a-44, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap149f6e1a-44, col_values=(('qos', UUID('7be3225e-7992-4a5d-b7c9-9442d739a968')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap149f6e1a-44, col_values=(('external_ids', {'iface-id': '149f6e1a-4425-4a14-9c12-2515d0a56efe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:f0:31', 'vm-uuid': '84b6410e-14ea-49ad-98f0-32933047ba58'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:09 user nova-compute[75071]: INFO os_vif [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f0:31,bridge_name='br-int',has_traffic_filtering=True,id=149f6e1a-4425-4a14-9c12-2515d0a56efe,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149f6e1a-44')
Nov 29 13:24:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] No VIF found with MAC fa:16:3e:e7:e3:db, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] No VIF found with MAC fa:16:3e:09:df:11, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:24:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Using config drive
Nov 29 13:24:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Creating config drive at /opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58/disk.config
Nov 29 13:24:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7z_pqqx4 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7z_pqqx4" returned: 0 in 0.075s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-174ed85c-1e53-4c95-9cda-874154d5d604 req-dd5db9b8-a321-4024-8ac4-f079c8b95544 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-174ed85c-1e53-4c95-9cda-874154d5d604 req-dd5db9b8-a321-4024-8ac4-f079c8b95544 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-174ed85c-1e53-4c95-9cda-874154d5d604 req-dd5db9b8-a321-4024-8ac4-f079c8b95544 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-174ed85c-1e53-4c95-9cda-874154d5d604 req-dd5db9b8-a321-4024-8ac4-f079c8b95544 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-174ed85c-1e53-4c95-9cda-874154d5d604 req-dd5db9b8-a321-4024-8ac4-f079c8b95544 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:11 user nova-compute[75071]: WARNING nova.compute.manager [req-174ed85c-1e53-4c95-9cda-874154d5d604 req-dd5db9b8-a321-4024-8ac4-f079c8b95544 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd for instance with vm_state building and task_state spawning.
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-691543d3-0fa3-42f9-b601-ad50c9f5d140 req-5106b90f-8e33-429a-b485-8286be656c0b service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-691543d3-0fa3-42f9-b601-ad50c9f5d140 req-5106b90f-8e33-429a-b485-8286be656c0b service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-691543d3-0fa3-42f9-b601-ad50c9f5d140 req-5106b90f-8e33-429a-b485-8286be656c0b service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-691543d3-0fa3-42f9-b601-ad50c9f5d140 req-5106b90f-8e33-429a-b485-8286be656c0b service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-691543d3-0fa3-42f9-b601-ad50c9f5d140 req-5106b90f-8e33-429a-b485-8286be656c0b service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:11 user nova-compute[75071]: WARNING nova.compute.manager [req-691543d3-0fa3-42f9-b601-ad50c9f5d140 req-5106b90f-8e33-429a-b485-8286be656c0b service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a for instance with vm_state building and task_state spawning.
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-29af5abf-e134-43b9-8675-bc0c5702605f req-f7915aa9-a3f2-4eee-92b7-9b3c9ace0c18 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-29af5abf-e134-43b9-8675-bc0c5702605f req-f7915aa9-a3f2-4eee-92b7-9b3c9ace0c18 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-29af5abf-e134-43b9-8675-bc0c5702605f req-f7915aa9-a3f2-4eee-92b7-9b3c9ace0c18 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-29af5abf-e134-43b9-8675-bc0c5702605f req-f7915aa9-a3f2-4eee-92b7-9b3c9ace0c18 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-29af5abf-e134-43b9-8675-bc0c5702605f req-f7915aa9-a3f2-4eee-92b7-9b3c9ace0c18 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:11 user nova-compute[75071]: WARNING nova.compute.manager [req-29af5abf-e134-43b9-8675-bc0c5702605f req-f7915aa9-a3f2-4eee-92b7-9b3c9ace0c18 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 for instance with vm_state building and task_state spawning.
Nov 29 13:24:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:13 user nova-compute[75071]: WARNING nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd for instance with vm_state building and task_state spawning.
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:13 user nova-compute[75071]: WARNING nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff for instance with vm_state building and task_state spawning.
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:13 user nova-compute[75071]: WARNING nova.compute.manager [req-d16aa384-636a-4a29-ab7b-9a971bc7ca84 req-ac62f119-0984-42c0-9e48-45118a77870e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff for instance with vm_state building and task_state spawning.
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-e78659a8-3774-42d8-bc64-f3ecbec1e68b req-6e371a37-4be6-42af-b1b8-d33c6221211b service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e78659a8-3774-42d8-bc64-f3ecbec1e68b req-6e371a37-4be6-42af-b1b8-d33c6221211b service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e78659a8-3774-42d8-bc64-f3ecbec1e68b req-6e371a37-4be6-42af-b1b8-d33c6221211b service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e78659a8-3774-42d8-bc64-f3ecbec1e68b req-6e371a37-4be6-42af-b1b8-d33c6221211b service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-e78659a8-3774-42d8-bc64-f3ecbec1e68b req-6e371a37-4be6-42af-b1b8-d33c6221211b service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:13 user nova-compute[75071]: WARNING nova.compute.manager [req-e78659a8-3774-42d8-bc64-f3ecbec1e68b req-6e371a37-4be6-42af-b1b8-d33c6221211b service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a for instance with vm_state building and task_state spawning.
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 945db3bb-5653-48f8-9c5f-2be1984e3cd2 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 64806dd7-0adb-4bb2-954a-707928115ce9 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid a0bdb312-835a-499a-af02-58f5f25f50e9 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 84b6410e-14ea-49ad-98f0-32933047ba58 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "6935d835-c98f-4355-8031-4436125925f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "6935d835-c98f-4355-8031-4436125925f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:14 user nova-compute[75071]: WARNING nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 for instance with vm_state building and task_state spawning.
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:14 user nova-compute[75071]: WARNING nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 for instance with vm_state building and task_state spawning.
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:14 user nova-compute[75071]: WARNING nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 for instance with vm_state building and task_state spawning.
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:14 user nova-compute[75071]: WARNING nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 for instance with vm_state building and task_state spawning.
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:14 user nova-compute[75071]: WARNING nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 for instance with vm_state building and task_state spawning.
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:14 user nova-compute[75071]: WARNING nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe for instance with vm_state building and task_state spawning.
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:14 user nova-compute[75071]: WARNING nova.compute.manager [req-ac9d719a-65a1-442f-a15a-7d30dd9ecbd0 req-c8191343-2e66-422b-9424-5f527761beca service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe for instance with vm_state building and task_state spawning.
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:24:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance spawned successfully.
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:15 user nova-compute[75071]: INFO nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Took 13.35 seconds to spawn the instance on the hypervisor.
Nov 29 13:24:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:24:15 user nova-compute[75071]: INFO nova.compute.manager [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Took 41.38 seconds to build instance.
Nov 29 13:24:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a17988d-72fc-4161-8445-37a5336fc25b tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "84b6410e-14ea-49ad-98f0-32933047ba58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.493s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "84b6410e-14ea-49ad-98f0-32933047ba58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.912s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:15 user nova-compute[75071]: INFO nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 29 13:24:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "84b6410e-14ea-49ad-98f0-32933047ba58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-changed-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Refreshing instance network info cache due to event network-changed-6049ab99-d0e5-4db3-85e3-927718b9092e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] Acquiring lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] Acquired lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Refreshing network info cache for port 6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:22 user nova-compute[75071]: INFO nova.compute.manager [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Detaching volume 52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:24:22 user nova-compute[75071]: INFO nova.virt.block_device [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Attempting to driver detach volume 52ea8ca0-7566-45a8-bcbe-b944f1fd6689 from mountpoint /dev/vdb
Nov 29 13:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Attempting to detach device vdb from instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:24:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:22 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:24:22 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:24:22 user nova-compute[75071]:   <serial>52ea8ca0-7566-45a8-bcbe-b944f1fd6689</serial>
Nov 29 13:24:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:24:22 user nova-compute[75071]: </disk>
Nov 29 13:24:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:24:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Successfully detached device vdb from instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 from the persistent domain config.
Nov 29 13:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:24:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:22 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:24:22 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:24:22 user nova-compute[75071]:   <serial>52ea8ca0-7566-45a8-bcbe-b944f1fd6689</serial>
Nov 29 13:24:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:24:22 user nova-compute[75071]: </disk>
Nov 29 13:24:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:24:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updated VIF entry in instance network info cache for port 6049ab99-d0e5-4db3-85e3-927718b9092e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:24:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updating instance_info_cache with network_info: [{"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4a307c5e-931b-4577-9069-f3136dc05d23 req-4fd7e0d5-13ce-4e19-bd09-306e5b01c454 service nova] Releasing lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:24:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c is timed out.
Nov 29 13:24:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully detached device vdb from instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c from the live domain config.
Nov 29 13:24:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNyqeDUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:24 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c8d779-2401-4ce9-83b7-2fb1948a27a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:24:24 user nova-compute[75071]: No targets found.
Nov 29 13:24:24 user nova-compute[75071]: iSNS:
Nov 29 13:24:24 user nova-compute[75071]: No targets found.
Nov 29 13:24:24 user nova-compute[75071]: STATIC:
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:24:24 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:24 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:24 user nova-compute[75071]: FIRMWARE:
Nov 29 13:24:24 user nova-compute[75071]: No targets found.
Nov 29 13:24:24 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:24:24 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:24:24 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac6839c-d060-4a16-947a-30d8e708b1ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30da09d3-7f92-407f-bc04-81487fa9b240]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:25 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148315870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5d4078-e1f8-40f2-b7fd-db3227006f4c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e08f495-3460-42f7-839a-b4268324c07d]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d3ebab-7cea-466e-b895-f36c9705405e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab547c7-474d-4080-9966-935db610f605]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[883101aa-b41f-4cd5-99bc-3f4dc276c945]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e345623e-820a-44e8-8253-0b633df9d8b6]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260]
Nov 29 13:24:25 user nova-compute[75071]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55, portal: 172.16.0.220,3260] successful.
Nov 29 13:24:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883dbcb6-4f9d-4469-ab00-47c241d1ef55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec1c7eb-e2e3-402e-b36d-505e5400c86d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== disconnect_volume: return (363ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:25 user nova-compute[75071]: INFO nova.compute.manager [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Attaching volume ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 to /dev/vdb
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.utils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324625d-95c3-41bc-8e0f-b0ed4044bc56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba7812a-f6ba-42bf-a7cb-3bc00d5e8718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c234a707-9d52-4a17-b63e-5217973c9f1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cdec07-017b-4e06-a7f2-15d3f365ca73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:24:25 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:24:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cee40-d5c3-4c98-b4f3-f7c67e08254a]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG os_brick.utils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:25 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updating existing volume attachment record: d0762b98-f262-423a-86da-b6e4335a4eae {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:24:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'flavor' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dd547a01-2ca8-4291-b310-91781daf4137 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.520s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.302s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFnfrzot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:34 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:34 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:34 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eaa6be-b70a-4ada-bbfe-93a835bdd4e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:24:34 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c0d4df-34cd-435b-8f46-cd459b1610cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984] added
Nov 29 13:24:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[414619cc-0ba3-44f3-b807-812a7c601ec4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2e522-79e5-4191-b769-51dd1725b457]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFnfrzot {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFnfrzot" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3018d13e-8505-44cc-87e1-8656a01fd7b0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFnfrzot'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f423a-1603-4b1d-8c0e-81dd69a7858c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3650025d-b611-4371-adbe-fe2a7cf25baa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[99afcf07-bf75-4cdd-a710-24c2d7053cd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260]
Nov 29 13:24:34 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260] successful.
Nov 29 13:24:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[44622f3f-5780-424a-be97-2948023fd8a2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[761e1bd2-07df-4c32-ac6e-446247faad73]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:34 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:24:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9f3663-9bdb-4980-a1bc-1bd3147340b4]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:24:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:24:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFnfrzot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:24:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26334346234653361', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334346234653361', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:24:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:24:35 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:24:35 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:24:35 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:24:35 user nova-compute[75071]:   <serial>ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984</serial>
Nov 29 13:24:35 user nova-compute[75071]: </disk>
Nov 29 13:24:35 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:24:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:24:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:24:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No VIF found with MAC fa:16:3e:c4:bc:e0, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:24:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c3268eec-0b52-47e5-b33f-0cb8c748b955 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.717s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "cf99d96e-7767-4a34-a4e9-f1a970506058" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:24:39 user nova-compute[75071]: INFO nova.compute.claims [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Claim successful on node user
Nov 29 13:24:39 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:24:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.policy [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '350e0cf65eeb441582c203ac06668009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f00a9cd6fd4b4398314100706a720b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:24:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Creating image(s)
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk 1073741824" returned: 0 in 0.052s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Successfully created port: 9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Cannot resize image /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Ensure instance console log exists: /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Successfully updated port: 9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquired lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received event network-changed-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Refreshing instance network info cache due to event network-changed-9fb1930d-7905-4c4d-a9d0-c427ea9833d1. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] Acquiring lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Updating instance_info_cache with network_info: [{"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Releasing lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Instance network_info: |[{"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] Acquired lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Refreshing network info cache for port 9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Start _get_guest_xml network_info=[{"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:24:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:24:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1488978385',display_name='tempest-AttachVolumeNegativeTest-server-1488978385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1488978385',id=19,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOroZizhQPJiELqRBWTMZtNhCs5jx1CdrZE4gidC1iaQhnQy8530qYsEktQqeKLgKG3r8ocNc3lKwBGBJA06utlgcstEUF5GB4uwq9+VN68qRySMwHogIAXRhEjoqvJ97A==',key_name='tempest-keypair-1080363194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-8bfdaz3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=cf99d96e-7767-4a34-a4e9-f1a970506058,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:db,bridge_name='br-int',has_traffic_filtering=True,id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb1930d-79') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.objects.instance [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'pci_devices' on Instance uuid cf99d96e-7767-4a34-a4e9-f1a970506058 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:24:42 user nova-compute[75071]:   <uuid>cf99d96e-7767-4a34-a4e9-f1a970506058</uuid>
Nov 29 13:24:42 user nova-compute[75071]:   <name>instance-00000013</name>
Nov 29 13:24:42 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:24:42 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:24:42 user nova-compute[75071]:   <metadata>
Nov 29 13:24:42 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:24:42 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:24:42 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1488978385</nova:name>
Nov 29 13:24:42 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:24:41</nova:creationTime>
Nov 29 13:24:42 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:24:42 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:24:42 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:24:42 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:24:42 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:24:42 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:24:42 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:24:42 user nova-compute[75071]:       <nova:owner>
Nov 29 13:24:42 user nova-compute[75071]:         <nova:user uuid="350e0cf65eeb441582c203ac06668009">tempest-AttachVolumeNegativeTest-1996696047-project-member</nova:user>
Nov 29 13:24:42 user nova-compute[75071]:         <nova:project uuid="f9f00a9cd6fd4b4398314100706a720b">tempest-AttachVolumeNegativeTest-1996696047</nova:project>
Nov 29 13:24:42 user nova-compute[75071]:       </nova:owner>
Nov 29 13:24:42 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:24:42 user nova-compute[75071]:       <nova:ports>
Nov 29 13:24:42 user nova-compute[75071]:         <nova:port uuid="9fb1930d-7905-4c4d-a9d0-c427ea9833d1">
Nov 29 13:24:42 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:24:42 user nova-compute[75071]:         </nova:port>
Nov 29 13:24:42 user nova-compute[75071]:       </nova:ports>
Nov 29 13:24:42 user nova-compute[75071]:     </nova:instance>
Nov 29 13:24:42 user nova-compute[75071]:   </metadata>
Nov 29 13:24:42 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:24:42 user nova-compute[75071]:     <system>
Nov 29 13:24:42 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:24:42 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:24:42 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:24:42 user nova-compute[75071]:       <entry name="serial">cf99d96e-7767-4a34-a4e9-f1a970506058</entry>
Nov 29 13:24:42 user nova-compute[75071]:       <entry name="uuid">cf99d96e-7767-4a34-a4e9-f1a970506058</entry>
Nov 29 13:24:42 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:24:42 user nova-compute[75071]:     </system>
Nov 29 13:24:42 user nova-compute[75071]:   </sysinfo>
Nov 29 13:24:42 user nova-compute[75071]:   <os>
Nov 29 13:24:42 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:24:42 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:24:42 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:24:42 user nova-compute[75071]:   </os>
Nov 29 13:24:42 user nova-compute[75071]:   <features>
Nov 29 13:24:42 user nova-compute[75071]:     <acpi/>
Nov 29 13:24:42 user nova-compute[75071]:     <apic/>
Nov 29 13:24:42 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:24:42 user nova-compute[75071]:   </features>
Nov 29 13:24:42 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:24:42 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:24:42 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:24:42 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:24:42 user nova-compute[75071]:   </clock>
Nov 29 13:24:42 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:24:42 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:24:42 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:24:42 user nova-compute[75071]:   </cpu>
Nov 29 13:24:42 user nova-compute[75071]:   <devices>
Nov 29 13:24:42 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:24:42 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:24:42 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk"/>
Nov 29 13:24:42 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:24:42 user nova-compute[75071]:     </disk>
Nov 29 13:24:42 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:24:42 user nova-compute[75071]:       <mac address="fa:16:3e:31:ab:db"/>
Nov 29 13:24:42 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:42 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:24:42 user nova-compute[75071]:       <target dev="tap9fb1930d-79"/>
Nov 29 13:24:42 user nova-compute[75071]:     </interface>
Nov 29 13:24:42 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:24:42 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/console.log" append="off"/>
Nov 29 13:24:42 user nova-compute[75071]:     </serial>
Nov 29 13:24:42 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:24:42 user nova-compute[75071]:     <video>
Nov 29 13:24:42 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:24:42 user nova-compute[75071]:     </video>
Nov 29 13:24:42 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:24:42 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:24:42 user nova-compute[75071]:     </rng>
Nov 29 13:24:42 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:24:42 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:24:42 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:24:42 user nova-compute[75071]:     </memballoon>
Nov 29 13:24:42 user nova-compute[75071]:   </devices>
Nov 29 13:24:42 user nova-compute[75071]: </domain>
Nov 29 13:24:42 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1488978385',display_name='tempest-AttachVolumeNegativeTest-server-1488978385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1488978385',id=19,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOroZizhQPJiELqRBWTMZtNhCs5jx1CdrZE4gidC1iaQhnQy8530qYsEktQqeKLgKG3r8ocNc3lKwBGBJA06utlgcstEUF5GB4uwq9+VN68qRySMwHogIAXRhEjoqvJ97A==',key_name='tempest-keypair-1080363194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-8bfdaz3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=cf99d96e-7767-4a34-a4e9-f1a970506058,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:db,bridge_name='br-int',has_traffic_filtering=True,id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb1930d-79') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG os_vif [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:db,bridge_name='br-int',has_traffic_filtering=True,id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb1930d-79') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97eaece0-beff-52d8-9fbf-a925f95f3e41', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fb1930d-79, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fb1930d-79, col_values=(('qos', UUID('a7342d72-5e58-414c-bc7e-865c4c8cfb41')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fb1930d-79, col_values=(('external_ids', {'iface-id': '9fb1930d-7905-4c4d-a9d0-c427ea9833d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:ab:db', 'vm-uuid': 'cf99d96e-7767-4a34-a4e9-f1a970506058'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:42 user nova-compute[75071]: INFO os_vif [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:db,bridge_name='br-int',has_traffic_filtering=True,id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb1930d-79')
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No VIF found with MAC fa:16:3e:31:ab:db, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Updated VIF entry in instance network info cache for port 9fb1930d-7905-4c4d-a9d0-c427ea9833d1. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Updating instance_info_cache with network_info: [{"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9bfd6025-72e1-485c-bb76-3f0a252a4397 req-787796c7-0f25-4bad-b9b6-5cbcbe62729e service nova] Releasing lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:24:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 is timed out.
Nov 29 13:24:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Successfully detached device vdb from instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 from the live domain config.
Nov 29 13:24:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajBQoicf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4702a8f1-466c-4236-8468-1f680b39824b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:24:43 user nova-compute[75071]: No targets found.
Nov 29 13:24:43 user nova-compute[75071]: iSNS:
Nov 29 13:24:43 user nova-compute[75071]: No targets found.
Nov 29 13:24:43 user nova-compute[75071]: STATIC:
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:24:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:24:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:24:43 user nova-compute[75071]: FIRMWARE:
Nov 29 13:24:43 user nova-compute[75071]: No targets found.
Nov 29 13:24:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:24:43 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:24:43 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a3c2b6-bd09-4552-86ef-0dd5d069e9c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[878fc058-1ad3-48cc-b193-290d6b88dec5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:24:43 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:24:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148412d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b86d0a-39e5-4273-867c-7338ab140661]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[590d27fe-ec35-40b4-8c0d-ed211cf8f3b2]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d98ecd-f163-4bd4-a497-5e230e6e9660]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dbcf8e-af2f-4eef-bbc5-3b448c50c506]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb75d254-264d-40a1-86af-d0abfa673c5b req-7e56c11f-e071-4283-b5d2-acb5f0e8d344 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received event network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb75d254-264d-40a1-86af-d0abfa673c5b req-7e56c11f-e071-4283-b5d2-acb5f0e8d344 service nova] Acquiring lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb75d254-264d-40a1-86af-d0abfa673c5b req-7e56c11f-e071-4283-b5d2-acb5f0e8d344 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb75d254-264d-40a1-86af-d0abfa673c5b req-7e56c11f-e071-4283-b5d2-acb5f0e8d344 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb75d254-264d-40a1-86af-d0abfa673c5b req-7e56c11f-e071-4283-b5d2-acb5f0e8d344 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] No waiting events found dispatching network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:43 user nova-compute[75071]: WARNING nova.compute.manager [req-eb75d254-264d-40a1-86af-d0abfa673c5b req-7e56c11f-e071-4283-b5d2-acb5f0e8d344 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received unexpected event network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 for instance with vm_state building and task_state spawning.
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a54fc6-ed55-4921-83a1-1d3cd24ab1f6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7992ff-89ae-48c1-b7ad-24d6f431e60e]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260]
Nov 29 13:24:43 user nova-compute[75071]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689, portal: 172.16.0.220,3260] successful.
Nov 29 13:24:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ea8ca0-7566-45a8-bcbe-b944f1fd6689 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43076587-9da1-4ec0-8235-529671b5abd7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] <== disconnect_volume: return (411ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:24:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'flavor' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c381f891-1c2a-4748-adb1-408da17041ab tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.848s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:24:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:24:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Skipping network cache update for instance because it is Building. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 13:24:45 user nova-compute[75071]: INFO nova.compute.manager [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] instance snapshotting
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 945db3bb-5653-48f8-9c5f-2be1984e3cd2 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Beginning live snapshot process
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updating instance_info_cache with network_info: [{"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-945db3bb-5653-48f8-9c5f-2be1984e3cd2" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:24:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Instance spawned successfully.
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec2b9aba-9145-4cb8-b921-5e1ac36f764b req-ce0d8841-b4d7-476f-ab7c-4d01ca5a5819 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received event network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec2b9aba-9145-4cb8-b921-5e1ac36f764b req-ce0d8841-b4d7-476f-ab7c-4d01ca5a5819 service nova] Acquiring lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec2b9aba-9145-4cb8-b921-5e1ac36f764b req-ce0d8841-b4d7-476f-ab7c-4d01ca5a5819 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec2b9aba-9145-4cb8-b921-5e1ac36f764b req-ce0d8841-b4d7-476f-ab7c-4d01ca5a5819 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec2b9aba-9145-4cb8-b921-5e1ac36f764b req-ce0d8841-b4d7-476f-ab7c-4d01ca5a5819 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] No waiting events found dispatching network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:24:45 user nova-compute[75071]: WARNING nova.compute.manager [req-ec2b9aba-9145-4cb8-b921-5e1ac36f764b req-ce0d8841-b4d7-476f-ab7c-4d01ca5a5819 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received unexpected event network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 for instance with vm_state building and task_state spawning.
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:24:45 user nova-compute[75071]: INFO nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 29 13:24:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9zy7w2w0/f2749f186a0a4f198ab95a64d77a13ae.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9zy7w2w0/f2749f186a0a4f198ab95a64d77a13ae.delta 1073741824" returned: 0 in 0.067s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 13:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:46 user nova-compute[75071]: INFO nova.compute.manager [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Took 6.51 seconds to build instance.
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-12fb9d13-14cb-477b-8258-0898f38e73bb tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.691s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] COPY block job progress, current cursor: 40828928 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:24:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-changed-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Refreshing instance network info cache due to event network-changed-ebfc46f1-0f4a-48af-93ce-d09eb4910676. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] Acquiring lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] Acquired lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Refreshing network info cache for port ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9zy7w2w0/f2749f186a0a4f198ab95a64d77a13ae.delta /opt/stack/data/nova/instances/snapshots/tmp9zy7w2w0/f2749f186a0a4f198ab95a64d77a13ae {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9zy7w2w0/f2749f186a0a4f198ab95a64d77a13ae.delta /opt/stack/data/nova/instances/snapshots/tmp9zy7w2w0/f2749f186a0a4f198ab95a64d77a13ae" returned: 0 in 0.662s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Snapshot extracted, beginning image upload
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Updated VIF entry in instance network info cache for port ebfc46f1-0f4a-48af-93ce-d09eb4910676. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Updating instance_info_cache with network_info: [{"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edd1a289-ade9-40aa-afd7-8e271b485334 req-f18bda52-dfbc-4b0f-b8b4-8359f64d6ad7 service nova] Releasing lock "refresh_cache-03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:24:50 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:50 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=6996MB free_disk=25.11206817626953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lazy-loading 'flavor' on Instance uuid 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 89d407c4-7e0e-4213-a2a2-99d547c42a4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 84b6410e-14ea-49ad-98f0-32933047ba58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance cf99d96e-7767-4a34-a4e9-f1a970506058 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:24:50 user nova-compute[75071]: INFO nova.compute.manager [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Attaching volume 71e473ff-f26a-4d45-820e-c53bd2142fe4 to /dev/sdc
Nov 29 13:24:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8ecd34-061b-472d-8eb0-68113ae444a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c1dac-fb30-42a1-9fda-7e79fb25d304]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba51b808-30c4-43fe-bd76-284ac4e30027]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e6096c-23b9-4d4c-ba1b-9eb174fc759a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:24:51 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc605a-4271-4f0a-91fd-9eb3ef86d74e]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Updating existing volume attachment record: 179b2de4-678b-431a-ae73-5bb8ec56f465 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:24:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Snapshot image upload complete
Nov 29 13:24:51 user nova-compute[75071]: INFO nova.compute.manager [None req-9e4d8df6-e753-4d17-8239-0f81f9b53556 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Took 6.44 seconds to snapshot the instance on the hypervisor.
Nov 29 13:24:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:24:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:24:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJmbTaVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:25:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:25:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:25:02 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb7fb1-88b3-45dc-8df8-853598c13419]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:25:02 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb13c38-f9bc-414b-b825-88be161a5c7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4] added
Nov 29 13:25:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b80989c-5672-4113-9769-d6cd6dee1d93]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3cacb5-d819-4b10-b486-7a46dad89ab3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJmbTaVY {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJmbTaVY" returned: 0 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ec8b2-d042-4118-a16f-0570a05cf7ea]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJmbTaVY'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d5037d-2fd3-4b0c-8c93-4a29811995a0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f47a7b-c2ab-4f9d-ba68-01d659e3eed8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:25:02 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:02 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:02 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:02 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:02 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:02 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a4a4a0-8e28-400d-ab1d-de31c846d5b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260]
Nov 29 13:25:03 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260] successful.
Nov 29 13:25:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fbd72a-85f0-415e-a5a9-2016927c7d91]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bdc25c-9ff3-4383-a9a9-c19f7aa5c5e4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)
Nov 29 13:25:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[368405b0-5b03-442f-9089-5edf67790797]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJmbTaVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:03 user nova-compute[75071]: INFO nova.compute.manager [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Terminating instance
Nov 29 13:25:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-7be16921-0a9b-40e6-a5c8-b4111d9b1111 req-4cb6065b-3f76-456d-bbbc-7b0f1cc06c26 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-unplugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7be16921-0a9b-40e6-a5c8-b4111d9b1111 req-4cb6065b-3f76-456d-bbbc-7b0f1cc06c26 service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7be16921-0a9b-40e6-a5c8-b4111d9b1111 req-4cb6065b-3f76-456d-bbbc-7b0f1cc06c26 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7be16921-0a9b-40e6-a5c8-b4111d9b1111 req-4cb6065b-3f76-456d-bbbc-7b0f1cc06c26 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-7be16921-0a9b-40e6-a5c8-b4111d9b1111 req-4cb6065b-3f76-456d-bbbc-7b0f1cc06c26 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-unplugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-7be16921-0a9b-40e6-a5c8-b4111d9b1111 req-4cb6065b-3f76-456d-bbbc-7b0f1cc06c26 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-unplugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23933333039353330', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933333039353330', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lazy-loading 'flavor' on Instance uuid 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:25:04 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:25:04 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:25:04 user nova-compute[75071]:   <target dev="sdc" bus="scsi"/>
Nov 29 13:25:04 user nova-compute[75071]:   <serial>71e473ff-f26a-4d45-820e-c53bd2142fe4</serial>
Nov 29 13:25:04 user nova-compute[75071]:   <address type="drive" controller="0" unit="2"/>
Nov 29 13:25:04 user nova-compute[75071]: </disk>
Nov 29 13:25:04 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:25:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Instance destroyed successfully.
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'resources' on Instance uuid f7c9047c-00f3-4cb3-9290-6d118bda1c9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:19:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1696092294',display_name='tempest-TestMinimumBasicScenario-server-1696092294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1696092294',id=12,image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5OU7wq777KNWtgTh49zMjolfl5F1CAP90X7BiOt3SVRTfAL0/XiizPFpYgWG55eFSvJkVxqUafEM3VDJwguK4WlVeppff2vZX9SAzGFHKsBnuuhLuRfBpx/2LcaRwUGQ==',key_name='tempest-TestMinimumBasicScenario-664367511',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:19:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-gx0s410n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1d86e741-7224-4df1-9d02-dd4ede829179',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:22:18Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=f7c9047c-00f3-4cb3-9290-6d118bda1c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "fc66d61b-df87-483c-96a1-89033c9deaa8", "address": "fa:16:3e:90:2e:ad", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc66d61b-df", "ovs_interfaceid": "fc66d61b-df87-483c-96a1-89033c9deaa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG os_vif [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc66d61b-df, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=048eb8dd-eeb2-4ad7-9e3e-e273e097b6b6) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:04 user nova-compute[75071]: INFO os_vif [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=fc66d61b-df87-483c-96a1-89033c9deaa8,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc66d61b-df')
Nov 29 13:25:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Deleting instance files /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c_del
Nov 29 13:25:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Deletion of /opt/stack/data/nova/instances/f7c9047c-00f3-4cb3-9290-6d118bda1c9c_del complete
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] No BDM found with device name sda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:25:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] No VIF found with MAC fa:16:3e:d2:4b:a7, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:25:05 user nova-compute[75071]: INFO nova.compute.manager [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 29 13:25:05 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94759175-6bce-4b33-a815-c38442eae11b tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.155s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:05 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Took 0.47 seconds to deallocate network for instance.
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-77aa03f3-352e-4baa-8c47-370d91f3a46a req-d9294aa5-68e2-40a1-abb1-9893d9a5b466 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-deleted-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:05 user nova-compute[75071]: INFO nova.compute.manager [req-77aa03f3-352e-4baa-8c47-370d91f3a46a req-d9294aa5-68e2-40a1-abb1-9893d9a5b466 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Neutron deleted interface fc66d61b-df87-483c-96a1-89033c9deaa8; detaching it from the instance and deleting it from the info cache
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-77aa03f3-352e-4baa-8c47-370d91f3a46a req-d9294aa5-68e2-40a1-abb1-9893d9a5b466 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-77aa03f3-352e-4baa-8c47-370d91f3a46a req-d9294aa5-68e2-40a1-abb1-9893d9a5b466 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Detach interface failed, port_id=fc66d61b-df87-483c-96a1-89033c9deaa8, reason: Instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:06 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Deleted allocations for instance f7c9047c-00f3-4cb3-9290-6d118bda1c9c
Nov 29 13:25:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c1efa18-4c34-4030-a5c0-dc7e96025a86 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.391s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-edaab435-0fc9-4b07-b8e4-64f43ff57281 req-ccc6e138-0281-4b36-8455-c9d61b4c2f21 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edaab435-0fc9-4b07-b8e4-64f43ff57281 req-ccc6e138-0281-4b36-8455-c9d61b4c2f21 service nova] Acquiring lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edaab435-0fc9-4b07-b8e4-64f43ff57281 req-ccc6e138-0281-4b36-8455-c9d61b4c2f21 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edaab435-0fc9-4b07-b8e4-64f43ff57281 req-ccc6e138-0281-4b36-8455-c9d61b4c2f21 service nova] Lock "f7c9047c-00f3-4cb3-9290-6d118bda1c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-edaab435-0fc9-4b07-b8e4-64f43ff57281 req-ccc6e138-0281-4b36-8455-c9d61b4c2f21 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] No waiting events found dispatching network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:06 user nova-compute[75071]: WARNING nova.compute.manager [req-edaab435-0fc9-4b07-b8e4-64f43ff57281 req-ccc6e138-0281-4b36-8455-c9d61b4c2f21 service nova] [instance: f7c9047c-00f3-4cb3-9290-6d118bda1c9c] Received unexpected event network-vif-plugged-fc66d61b-df87-483c-96a1-89033c9deaa8 for instance with vm_state deleted and task_state None.
Nov 29 13:25:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:06 user nova-compute[75071]: INFO nova.compute.manager [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Detaching volume 71e473ff-f26a-4d45-820e-c53bd2142fe4
Nov 29 13:25:06 user nova-compute[75071]: INFO nova.virt.block_device [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Attempting to driver detach volume 71e473ff-f26a-4d45-820e-c53bd2142fe4 from mountpoint /dev/sdc
Nov 29 13:25:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Attempting to detach device sdc from instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:25:06 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:25:06 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:25:06 user nova-compute[75071]:   <target dev="sdc" bus="scsi"/>
Nov 29 13:25:06 user nova-compute[75071]:   <serial>71e473ff-f26a-4d45-820e-c53bd2142fe4</serial>
Nov 29 13:25:06 user nova-compute[75071]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 13:25:06 user nova-compute[75071]: </disk>
Nov 29 13:25:06 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:25:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Successfully detached device sdc from instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b from the persistent domain config.
Nov 29 13:25:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:25:06 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:25:06 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:25:06 user nova-compute[75071]:   <target dev="sdc" bus="scsi"/>
Nov 29 13:25:06 user nova-compute[75071]:   <serial>71e473ff-f26a-4d45-820e-c53bd2142fe4</serial>
Nov 29 13:25:06 user nova-compute[75071]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 13:25:06 user nova-compute[75071]: </disk>
Nov 29 13:25:06 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:25:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:25:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:25:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:08 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:25:08 user nova-compute[75071]: INFO nova.compute.claims [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Claim successful on node user
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:25:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.policy [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '013770deb90c4a83a4a822afdc45a2b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34bfa3e9f6b47beb18fb97da4bfb176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:25:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Creating image(s)
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk 1073741824" returned: 0 in 0.260s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.462s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.228s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Successfully created port: 8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Cannot resize image /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Ensure instance console log exists: /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Successfully updated port: 8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquired lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing instance network info cache due to event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] Acquiring lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Releasing lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance network_info: |[{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] Acquired lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Start _get_guest_xml network_info=[{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:25:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:25:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1897835708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1897835708',id=20,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXsJ5XQa2UWegE5sMjsQzlXf2iXtgaMgOt29b5FNqf5KhFVTOCjbdjPWgrKECK3+uPt8/RcqdROcEYKm0ZLCBWwPc3xPwy8nYxmWLtQaXOoiEiqMokCgoy016PpX/yRuA==',key_name='tempest-keypair-973435994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-3z5pz8a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=73c90d9c-3089-4d7b-9ac9-7c2105cd4649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'pci_devices' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:25:11 user nova-compute[75071]:   <uuid>73c90d9c-3089-4d7b-9ac9-7c2105cd4649</uuid>
Nov 29 13:25:11 user nova-compute[75071]:   <name>instance-00000014</name>
Nov 29 13:25:11 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:25:11 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:25:11 user nova-compute[75071]:   <metadata>
Nov 29 13:25:11 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:25:11 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:25:11 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1897835708</nova:name>
Nov 29 13:25:11 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:25:11</nova:creationTime>
Nov 29 13:25:11 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:25:11 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:25:11 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:25:11 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:25:11 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:25:11 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:25:11 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:25:11 user nova-compute[75071]:       <nova:owner>
Nov 29 13:25:11 user nova-compute[75071]:         <nova:user uuid="013770deb90c4a83a4a822afdc45a2b9">tempest-AttachVolumeShelveTestJSON-2031472443-project-member</nova:user>
Nov 29 13:25:11 user nova-compute[75071]:         <nova:project uuid="c34bfa3e9f6b47beb18fb97da4bfb176">tempest-AttachVolumeShelveTestJSON-2031472443</nova:project>
Nov 29 13:25:11 user nova-compute[75071]:       </nova:owner>
Nov 29 13:25:11 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:25:11 user nova-compute[75071]:       <nova:ports>
Nov 29 13:25:11 user nova-compute[75071]:         <nova:port uuid="8b97467c-89dd-4ec6-b403-1dcee24246e1">
Nov 29 13:25:11 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:25:11 user nova-compute[75071]:         </nova:port>
Nov 29 13:25:11 user nova-compute[75071]:       </nova:ports>
Nov 29 13:25:11 user nova-compute[75071]:     </nova:instance>
Nov 29 13:25:11 user nova-compute[75071]:   </metadata>
Nov 29 13:25:11 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:25:11 user nova-compute[75071]:     <system>
Nov 29 13:25:11 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:25:11 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:25:11 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:25:11 user nova-compute[75071]:       <entry name="serial">73c90d9c-3089-4d7b-9ac9-7c2105cd4649</entry>
Nov 29 13:25:11 user nova-compute[75071]:       <entry name="uuid">73c90d9c-3089-4d7b-9ac9-7c2105cd4649</entry>
Nov 29 13:25:11 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:25:11 user nova-compute[75071]:     </system>
Nov 29 13:25:11 user nova-compute[75071]:   </sysinfo>
Nov 29 13:25:11 user nova-compute[75071]:   <os>
Nov 29 13:25:11 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:25:11 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:25:11 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:25:11 user nova-compute[75071]:   </os>
Nov 29 13:25:11 user nova-compute[75071]:   <features>
Nov 29 13:25:11 user nova-compute[75071]:     <acpi/>
Nov 29 13:25:11 user nova-compute[75071]:     <apic/>
Nov 29 13:25:11 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:25:11 user nova-compute[75071]:   </features>
Nov 29 13:25:11 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:25:11 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:25:11 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:25:11 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:25:11 user nova-compute[75071]:   </clock>
Nov 29 13:25:11 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:25:11 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:25:11 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:25:11 user nova-compute[75071]:   </cpu>
Nov 29 13:25:11 user nova-compute[75071]:   <devices>
Nov 29 13:25:11 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:25:11 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:25:11 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk"/>
Nov 29 13:25:11 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:25:11 user nova-compute[75071]:     </disk>
Nov 29 13:25:11 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:25:11 user nova-compute[75071]:       <mac address="fa:16:3e:01:d1:6a"/>
Nov 29 13:25:11 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:25:11 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:25:11 user nova-compute[75071]:       <target dev="tap8b97467c-89"/>
Nov 29 13:25:11 user nova-compute[75071]:     </interface>
Nov 29 13:25:11 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:25:11 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/console.log" append="off"/>
Nov 29 13:25:11 user nova-compute[75071]:     </serial>
Nov 29 13:25:11 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:25:11 user nova-compute[75071]:     <video>
Nov 29 13:25:11 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:25:11 user nova-compute[75071]:     </video>
Nov 29 13:25:11 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:25:11 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:25:11 user nova-compute[75071]:     </rng>
Nov 29 13:25:11 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:25:11 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:25:11 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:25:11 user nova-compute[75071]:     </memballoon>
Nov 29 13:25:11 user nova-compute[75071]:   </devices>
Nov 29 13:25:11 user nova-compute[75071]: </domain>
Nov 29 13:25:11 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1897835708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1897835708',id=20,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXsJ5XQa2UWegE5sMjsQzlXf2iXtgaMgOt29b5FNqf5KhFVTOCjbdjPWgrKECK3+uPt8/RcqdROcEYKm0ZLCBWwPc3xPwy8nYxmWLtQaXOoiEiqMokCgoy016PpX/yRuA==',key_name='tempest-keypair-973435994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-3z5pz8a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=73c90d9c-3089-4d7b-9ac9-7c2105cd4649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG os_vif [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '903d34f8-59da-587a-ad29-ab0dfb3aeb6d', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b97467c-89, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b97467c-89, col_values=(('qos', UUID('1c5bfcb7-5f75-46c4-b7fa-6817c4e2caea')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b97467c-89, col_values=(('external_ids', {'iface-id': '8b97467c-89dd-4ec6-b403-1dcee24246e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:d1:6a', 'vm-uuid': '73c90d9c-3089-4d7b-9ac9-7c2105cd4649'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:11 user nova-compute[75071]: INFO os_vif [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89')
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No VIF found with MAC fa:16:3e:01:d1:6a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updated VIF entry in instance network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b6444b9-4158-4cd7-87d8-2a36a6301d0c req-9680f956-fbba-42aa-960c-1662a1e80403 service nova] Releasing lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing instance network info cache due to event network-changed-ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] Acquiring lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] Acquired lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Refreshing network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:12 user nova-compute[75071]: INFO nova.compute.manager [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Terminating instance
Nov 29 13:25:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updated VIF entry in instance network info cache for port ebb73234-ca47-4314-a8e2-a16cce479217. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [{"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9ecf0e32-739a-4f8c-a60e-747c310ac28e req-9f2ef1ae-0f0b-41d8-a872-0697a5a87c0e service nova] Releasing lock "refresh_cache-89d407c4-7e0e-4213-a2a2-99d547c42a4c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-unplugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-unplugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-unplugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] Acquiring lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] No waiting events found dispatching network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:13 user nova-compute[75071]: WARNING nova.compute.manager [req-bf98a4a8-4d4d-428d-b81a-a07653d3af96 req-61a9c0ec-aad0-4cfb-b013-452e214170f9 service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received unexpected event network-vif-plugged-ebb73234-ca47-4314-a8e2-a16cce479217 for instance with vm_state active and task_state deleting.
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Instance destroyed successfully.
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lazy-loading 'resources' on Instance uuid 89d407c4-7e0e-4213-a2a2-99d547c42a4c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-878992995',display_name='tempest-TestShelveInstance-server-878992995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-878992995',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3l5psQ+RFAOK4Bmf81fxopedVDeR2Xv3emIdqPVEMZ4lQ3fRN6u7br81LSROFbo78BoT0QVP3ZpQw2is7bxCC+v9VSWxo9qONy36RA8t5MnIp983IR0xu8Al/0PDLpvQ==',key_name='tempest-TestShelveInstance-76113716',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e33dac7a205d476ba368ab85fa20387d',ramdisk_id='',reservation_id='r-3amg8rr4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-260027550',owner_user_name='tempest-TestShelveInstance-260027550-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:23:37Z,user_data=None,user_id='754229134eaf4fd18d8b0680e74ddd90',uuid=89d407c4-7e0e-4213-a2a2-99d547c42a4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converting VIF {"id": "ebb73234-ca47-4314-a8e2-a16cce479217", "address": "fa:16:3e:49:68:09", "network": {"id": "ae06ecf4-e156-4792-971d-8833393aafb2", "bridge": "br-int", "label": "tempest-TestShelveInstance-722732050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e33dac7a205d476ba368ab85fa20387d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb73234-ca", "ovs_interfaceid": "ebb73234-ca47-4314-a8e2-a16cce479217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_vif [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb73234-ca, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e36c8243-89f5-4410-86b3-0242cad042e9) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: INFO os_vif [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:68:09,bridge_name='br-int',has_traffic_filtering=True,id=ebb73234-ca47-4314-a8e2-a16cce479217,network=Network(ae06ecf4-e156-4792-971d-8833393aafb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebb73234-ca')
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uCiILDgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:25:13 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:25:13 user nova-compute[75071]: INFO nova.compute.manager [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Terminating instance
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[163daf10-8d68-4022-81ef-5c90d8ec7ce8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:25:13 user nova-compute[75071]: No targets found.
Nov 29 13:25:13 user nova-compute[75071]: iSNS:
Nov 29 13:25:13 user nova-compute[75071]: No targets found.
Nov 29 13:25:13 user nova-compute[75071]: STATIC:
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4
Nov 29 13:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:13 user nova-compute[75071]: FIRMWARE:
Nov 29 13:25:13 user nova-compute[75071]: No targets found.
Nov 29 13:25:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:25:13 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:25:13 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[94064da0-b9f5-4659-8559-f48f33ec0df0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de401754-d288-4d2c-bfb4-8147c29664fb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)
Nov 29 13:25:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d52050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c9337-c0ce-479b-8a0e-29493a3c4c24]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab380f1-40ce-488f-8ad7-c0c1424f35bf]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8422df37-feb3-493e-ad64-398a843caf63]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce149e6f-3025-47bb-bc0b-0b88b73dc80f]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbc173e-6343-43da-86c5-3775c507a5b1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9ed832e-0c1d-4eb1-b2d1-71fa1070ddee req-c2adcf04-3ebf-49b4-828f-cb6b5feacdbe service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9ed832e-0c1d-4eb1-b2d1-71fa1070ddee req-c2adcf04-3ebf-49b4-828f-cb6b5feacdbe service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9ed832e-0c1d-4eb1-b2d1-71fa1070ddee req-c2adcf04-3ebf-49b4-828f-cb6b5feacdbe service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9ed832e-0c1d-4eb1-b2d1-71fa1070ddee req-c2adcf04-3ebf-49b4-828f-cb6b5feacdbe service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9ed832e-0c1d-4eb1-b2d1-71fa1070ddee req-c2adcf04-3ebf-49b4-828f-cb6b5feacdbe service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9ed832e-0c1d-4eb1-b2d1-71fa1070ddee req-c2adcf04-3ebf-49b4-828f-cb6b5feacdbe service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-unplugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d1ed2-3273-4102-ae6b-6702b22cbb6c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260]
Nov 29 13:25:14 user nova-compute[75071]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1, portal: 172.16.0.220,3260] successful.
Nov 29 13:25:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49892357-0234-42db-918a-026a37e4f1f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c3b425-0e38-401e-9173-30ccadf50c15]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] <== disconnect_volume: return (459ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Deleting instance files /opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c_del
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Deletion of /opt/stack/data/nova/instances/89d407c4-7e0e-4213-a2a2-99d547c42a4c_del complete
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:14 user nova-compute[75071]: WARNING nova.compute.manager [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received unexpected event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with vm_state building and task_state spawning.
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:14 user nova-compute[75071]: WARNING nova.compute.manager [req-fd34e612-f054-40ae-8c5a-e1fa59ce3967 req-531aebb3-436e-4555-834e-9726960b9d11 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received unexpected event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with vm_state building and task_state spawning.
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.compute.manager [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Took 1.99 seconds to destroy the instance on the hypervisor.
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Instance destroyed successfully.
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lazy-loading 'resources' on Instance uuid ef8e7624-0193-4ba9-ae01-0a3a140f7a67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-984259261',display_name='tempest-ServerStableDeviceRescueTest-server-984259261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-984259261',id=4,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv956hhwxyofSbjnRV0xi2CXYQE5UqmKJmiBvc7uy5OHP1EnD8bvo08Zk4kcfLuw5dJBMKfe1b5SxaP7G0BrioQI7K2kAjL5OEBhKZIsjjhm9bfUXebdoLLCjwnfxHAow==',key_name='tempest-keypair-1727047100',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c77e1870fa1242049bc58bcdd5a91376',ramdisk_id='',reservation_id='r-az0rg775',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-798793767',owner_user_name='tempest-ServerStableDeviceRescueTest-798793767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f196295464214feb8986122fa9fca139',uuid=ef8e7624-0193-4ba9-ae01-0a3a140f7a67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converting VIF {"id": "16906a3e-623e-41b2-9940-0d068b2c5625", "address": "fa:16:3e:00:b2:03", "network": {"id": "7cb78ca5-3558-48f0-a6ce-7d2fc5a66848", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1045049631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c77e1870fa1242049bc58bcdd5a91376", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16906a3e-62", "ovs_interfaceid": "16906a3e-623e-41b2-9940-0d068b2c5625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG os_vif [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16906a3e-62, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8e35468-4a16-4ad3-bbe5-d9505e27f2a7) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:14 user nova-compute[75071]: INFO os_vif [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:b2:03,bridge_name='br-int',has_traffic_filtering=True,id=16906a3e-623e-41b2-9940-0d068b2c5625,network=Network(7cb78ca5-3558-48f0-a6ce-7d2fc5a66848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16906a3e-62')
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Deleting instance files /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67_del
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Deletion of /opt/stack/data/nova/instances/ef8e7624-0193-4ba9-ae01-0a3a140f7a67_del complete
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.compute.manager [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 13:25:14 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:25:14 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:14 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Took 0.45 seconds to deallocate network for instance.
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4855e9a-fb44-466c-bd69-b936f3c97b4e req-f48c4c4d-f959-4e5d-a6dd-a461eddbafdd service nova] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Received event network-vif-deleted-ebb73234-ca47-4314-a8e2-a16cce479217 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:15 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Took 0.85 seconds to deallocate network for instance.
Nov 29 13:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:15 user nova-compute[75071]: INFO nova.compute.manager [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Took 0.80 seconds to detach 1 volumes for instance.
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] [instance: 89d407c4-7e0e-4213-a2a2-99d547c42a4c] Deleting volume: 49892357-0234-42db-918a-026a37e4f1f1 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:25:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance spawned successfully.
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:15 user nova-compute[75071]: INFO nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:25:15 user nova-compute[75071]: INFO nova.compute.manager [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Took 6.89 seconds to build instance.
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0329d3b-e49a-4f8a-9cca-a52981c85b64 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.998s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.257s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:15 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Deleted allocations for instance ef8e7624-0193-4ba9-ae01-0a3a140f7a67
Nov 29 13:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36a25d02-f851-41ab-9647-f512f443af84 tempest-ServerStableDeviceRescueTest-798793767 tempest-ServerStableDeviceRescueTest-798793767-project-member] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-75f52055-f70d-44a1-b34c-76f1d7acb425 req-372654f6-631b-49fa-9c06-357e628228c7 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75f52055-f70d-44a1-b34c-76f1d7acb425 req-372654f6-631b-49fa-9c06-357e628228c7 service nova] Acquiring lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75f52055-f70d-44a1-b34c-76f1d7acb425 req-372654f6-631b-49fa-9c06-357e628228c7 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75f52055-f70d-44a1-b34c-76f1d7acb425 req-372654f6-631b-49fa-9c06-357e628228c7 service nova] Lock "ef8e7624-0193-4ba9-ae01-0a3a140f7a67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-75f52055-f70d-44a1-b34c-76f1d7acb425 req-372654f6-631b-49fa-9c06-357e628228c7 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] No waiting events found dispatching network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:16 user nova-compute[75071]: WARNING nova.compute.manager [req-75f52055-f70d-44a1-b34c-76f1d7acb425 req-372654f6-631b-49fa-9c06-357e628228c7 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received unexpected event network-vif-plugged-16906a3e-623e-41b2-9940-0d068b2c5625 for instance with vm_state deleted and task_state None.
Nov 29 13:25:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-75f52055-f70d-44a1-b34c-76f1d7acb425 req-372654f6-631b-49fa-9c06-357e628228c7 service nova] [instance: ef8e7624-0193-4ba9-ae01-0a3a140f7a67] Received event network-vif-deleted-16906a3e-623e-41b2-9940-0d068b2c5625 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:16 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Deleted allocations for instance 89d407c4-7e0e-4213-a2a2-99d547c42a4c
Nov 29 13:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e7c60f13-0b27-4de5-9b2b-fece023c6845 tempest-TestShelveInstance-260027550 tempest-TestShelveInstance-260027550-project-member] Lock "89d407c4-7e0e-4213-a2a2-99d547c42a4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.202s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-changed-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing instance network info cache due to event network-changed-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:25:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] Acquiring lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:25:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] Acquired lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:25:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Refreshing network info cache for port 12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:25:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updated VIF entry in instance network info cache for port 12a2c809-c585-4ef3-b1ce-17bd3df2bbbd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:25:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d2b38228-ce20-4fac-8c1d-55d776c91835 req-6f1cfb6c-b318-482f-a463-d9bc9d3e31f9 service nova] Releasing lock "refresh_cache-84b6410e-14ea-49ad-98f0-32933047ba58" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:25:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b is timed out.
Nov 29 13:25:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Successfully detached device sdc from instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b from the live domain config.
Nov 29 13:25:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJmbTaVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:25:26 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7151922a-51ec-4cfb-bd6e-b197a8b1d0d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:25:26 user nova-compute[75071]: No targets found.
Nov 29 13:25:26 user nova-compute[75071]: iSNS:
Nov 29 13:25:26 user nova-compute[75071]: No targets found.
Nov 29 13:25:26 user nova-compute[75071]: STATIC:
Nov 29 13:25:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:25:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:26 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504
Nov 29 13:25:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:26 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:25:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:26 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:25:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:26 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb
Nov 29 13:25:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:26 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa
Nov 29 13:25:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:26 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4
Nov 29 13:25:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:26 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:26 user nova-compute[75071]: FIRMWARE:
Nov 29 13:25:26 user nova-compute[75071]: No targets found.
Nov 29 13:25:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:25:26 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:25:26 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d2d39d-0bbd-43e2-a9fe-8f00c8c9d28d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cc96f5-d65a-4652-8929-6aca8d95dba4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)
Nov 29 13:25:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:26 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 (non-flash)
Nov 29 13:25:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e38ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[197cef58-ad63-4d09-a489-c156025c2580]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bdd060-8904-4ef2-ad1e-2c9c24db452f]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8796300-18a0-4a4d-87f6-52a98e0879b4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:25:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a00bc6-d090-461f-84d9-ea3b2ef2ac4c]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925b05a-ed98-4098-8691-702308da67a0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ef3525-2510-4838-821d-b660e45a3604]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260]
Nov 29 13:25:27 user nova-compute[75071]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4, portal: 172.16.0.220,3260] successful.
Nov 29 13:25:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71e473ff-f26a-4d45-820e-c53bd2142fe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5f9d9a-6103-4b94-bb5b-197c85bf02fc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] <== disconnect_volume: return (340ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lazy-loading 'flavor' on Instance uuid 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b95b81b2-0b48-4b8c-bad3-27a932c5b8ae tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "84b6410e-14ea-49ad-98f0-32933047ba58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:28 user nova-compute[75071]: INFO nova.compute.manager [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Terminating instance
Nov 29 13:25:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6bb4836-18a9-4c3c-9a81-fc683dee1d8c req-a9ab35b1-f576-4fdc-b95f-28bbac20f614 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6bb4836-18a9-4c3c-9a81-fc683dee1d8c req-a9ab35b1-f576-4fdc-b95f-28bbac20f614 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6bb4836-18a9-4c3c-9a81-fc683dee1d8c req-a9ab35b1-f576-4fdc-b95f-28bbac20f614 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6bb4836-18a9-4c3c-9a81-fc683dee1d8c req-a9ab35b1-f576-4fdc-b95f-28bbac20f614 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6bb4836-18a9-4c3c-9a81-fc683dee1d8c req-a9ab35b1-f576-4fdc-b95f-28bbac20f614 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-unplugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6bb4836-18a9-4c3c-9a81-fc683dee1d8c req-a9ab35b1-f576-4fdc-b95f-28bbac20f614 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-ccba4d13-f8a6-42ea-b552-20c0ec9c388b req-9c695966-d035-4926-9b69-1e25e428bafb service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ccba4d13-f8a6-42ea-b552-20c0ec9c388b req-9c695966-d035-4926-9b69-1e25e428bafb service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ccba4d13-f8a6-42ea-b552-20c0ec9c388b req-9c695966-d035-4926-9b69-1e25e428bafb service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ccba4d13-f8a6-42ea-b552-20c0ec9c388b req-9c695966-d035-4926-9b69-1e25e428bafb service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-ccba4d13-f8a6-42ea-b552-20c0ec9c388b req-9c695966-d035-4926-9b69-1e25e428bafb service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-unplugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-ccba4d13-f8a6-42ea-b552-20c0ec9c388b req-9c695966-d035-4926-9b69-1e25e428bafb service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb7514ee-fb83-4c13-86d1-2e9e3a79f80d req-83a237b5-c76a-4004-9598-b55dbb17186e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb7514ee-fb83-4c13-86d1-2e9e3a79f80d req-83a237b5-c76a-4004-9598-b55dbb17186e service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb7514ee-fb83-4c13-86d1-2e9e3a79f80d req-83a237b5-c76a-4004-9598-b55dbb17186e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb7514ee-fb83-4c13-86d1-2e9e3a79f80d req-83a237b5-c76a-4004-9598-b55dbb17186e service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb7514ee-fb83-4c13-86d1-2e9e3a79f80d req-83a237b5-c76a-4004-9598-b55dbb17186e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-unplugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb7514ee-fb83-4c13-86d1-2e9e3a79f80d req-83a237b5-c76a-4004-9598-b55dbb17186e service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-2ddafa0f-75cc-434f-8a5f-164201102d76 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:29 user nova-compute[75071]: INFO nova.compute.manager [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Terminating instance
Nov 29 13:25:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Instance destroyed successfully.
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lazy-loading 'resources' on Instance uuid 84b6410e-14ea-49ad-98f0-32933047ba58 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=12a2c809-c585-4ef3-b1ce-17bd3df2bbbd,network=Network(a76d1c25-afe7-49b0-bd21-fa2ac6d26784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a2c809-c5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=12a2c809-c585-4ef3-b1ce-17bd3df2bbbd,network=Network(a76d1c25-afe7-49b0-bd21-fa2ac6d26784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a2c809-c5') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12a2c809-c5, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Instance destroyed successfully.
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lazy-loading 'resources' on Instance uuid 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:22:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1878803636',display_name='tempest-AttachSCSIVolumeTestJSON-server-1878803636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1878803636',id=17,image_ref='0ad74a75-840b-4e74-834a-3772a04de1d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBMKwBbgQ4xBUaM12lzIawHHfm3dQ0bygVqr79aRYbGlVPxU3i2ce78PoEUJroGZz7y7Ni2TphaD0c9XtmLW76i8IMxqXExJUeYMPbBl99s4TIObwUcfpQ8s9tm7aTC3w==',key_name='tempest-keypair-1848736999',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:23:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f748a7e2162477ba4aeb4e16f349f37',ramdisk_id='',reservation_id='r-pcqea6m0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0ad74a75-840b-4e74-834a-3772a04de1d6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2028645872',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2028645872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:23:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef26a0d898244c73be33730e771e037a',uuid=03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Converting VIF {"id": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "address": "fa:16:3e:d2:4b:a7", "network": {"id": "748c3fe8-f18e-494f-8211-c0cdd1b61e07", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-655758827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f748a7e2162477ba4aeb4e16f349f37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebfc46f1-0f", "ovs_interfaceid": "ebfc46f1-0f4a-48af-93ce-d09eb4910676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:4b:a7,bridge_name='br-int',has_traffic_filtering=True,id=ebfc46f1-0f4a-48af-93ce-d09eb4910676,network=Network(748c3fe8-f18e-494f-8211-c0cdd1b61e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfc46f1-0f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG os_vif [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:4b:a7,bridge_name='br-int',has_traffic_filtering=True,id=ebfc46f1-0f4a-48af-93ce-d09eb4910676,network=Network(748c3fe8-f18e-494f-8211-c0cdd1b61e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfc46f1-0f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebfc46f1-0f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b758468c-fe1a-4442-b435-2801c7292f88) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82f6c2a2-cf5a-481e-9685-43de5fa84b23) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: INFO os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:e3:db,bridge_name='br-int',has_traffic_filtering=True,id=12a2c809-c585-4ef3-b1ce-17bd3df2bbbd,network=Network(a76d1c25-afe7-49b0-bd21-fa2ac6d26784),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12a2c809-c5')
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:71,bridge_name='br-int',has_traffic_filtering=True,id=4b2e7ffe-9534-4809-9de9-63a997b0da9a,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b2e7ffe-95') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:71,bridge_name='br-int',has_traffic_filtering=True,id=4b2e7ffe-9534-4809-9de9-63a997b0da9a,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b2e7ffe-95') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b2e7ffe-95, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: INFO os_vif [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:4b:a7,bridge_name='br-int',has_traffic_filtering=True,id=ebfc46f1-0f4a-48af-93ce-d09eb4910676,network=Network(748c3fe8-f18e-494f-8211-c0cdd1b61e07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebfc46f1-0f')
Nov 29 13:25:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Deleting instance files /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b_del
Nov 29 13:25:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Deletion of /opt/stack/data/nova/instances/03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b_del complete
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a74b2394-9eab-4c50-a60f-9d11c166c43a) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:30 user nova-compute[75071]: WARNING nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd for instance with vm_state active and task_state deleting.
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-unplugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:30 user nova-compute[75071]: WARNING nova.compute.manager [req-549e6e2e-d251-4b81-8616-788db5ae1c8b req-7d284799-1d25-4d45-bf19-0247f3fc112d service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-f7a25def-1380-46fc-9fcc-ced472fdf3ff for instance with vm_state active and task_state deleting.
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: INFO nova.compute.manager [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: INFO os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:47:71,bridge_name='br-int',has_traffic_filtering=True,id=4b2e7ffe-9534-4809-9de9-63a997b0da9a,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b2e7ffe-95')
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=2ddafa0f-75cc-434f-8a5f-164201102d76,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ddafa0f-75') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=2ddafa0f-75cc-434f-8a5f-164201102d76,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ddafa0f-75') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ddafa0f-75, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c5b4db4-c62e-4b77-a757-77d491659750) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: INFO os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:cb:70,bridge_name='br-int',has_traffic_filtering=True,id=2ddafa0f-75cc-434f-8a5f-164201102d76,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ddafa0f-75')
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:0a:e7,bridge_name='br-int',has_traffic_filtering=True,id=bda0814a-ec11-4f93-93ec-6d58a49e0776,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbda0814a-ec') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:0a:e7,bridge_name='br-int',has_traffic_filtering=True,id=bda0814a-ec11-4f93-93ec-6d58a49e0776,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbda0814a-ec') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbda0814a-ec, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-d20bced6-a65c-4926-a7c7-ec810da97ec0 req-d73bfb33-0cb6-4da9-9ff6-f69dfeedf123 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d20bced6-a65c-4926-a7c7-ec810da97ec0 req-d73bfb33-0cb6-4da9-9ff6-f69dfeedf123 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d20bced6-a65c-4926-a7c7-ec810da97ec0 req-d73bfb33-0cb6-4da9-9ff6-f69dfeedf123 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d20bced6-a65c-4926-a7c7-ec810da97ec0 req-d73bfb33-0cb6-4da9-9ff6-f69dfeedf123 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-d20bced6-a65c-4926-a7c7-ec810da97ec0 req-d73bfb33-0cb6-4da9-9ff6-f69dfeedf123 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:30 user nova-compute[75071]: WARNING nova.compute.manager [req-d20bced6-a65c-4926-a7c7-ec810da97ec0 req-d73bfb33-0cb6-4da9-9ff6-f69dfeedf123 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-4b2e7ffe-9534-4809-9de9-63a997b0da9a for instance with vm_state active and task_state deleting.
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c8e5022-36d9-4008-b0d4-e9dd912b4023) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: INFO os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:0a:e7,bridge_name='br-int',has_traffic_filtering=True,id=bda0814a-ec11-4f93-93ec-6d58a49e0776,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbda0814a-ec')
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "address": "fa:16:3e:09:df:11", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7a25def-13", "ovs_interfaceid": "f7a25def-1380-46fc-9fcc-ced472fdf3ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:df:11,bridge_name='br-int',has_traffic_filtering=True,id=f7a25def-1380-46fc-9fcc-ced472fdf3ff,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7a25def-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:df:11,bridge_name='br-int',has_traffic_filtering=True,id=f7a25def-1380-46fc-9fcc-ced472fdf3ff,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7a25def-13') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7a25def-13, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4de89e8d-0e36-4e75-a467-240a4a2365b1) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: INFO os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:df:11,bridge_name='br-int',has_traffic_filtering=True,id=f7a25def-1380-46fc-9fcc-ced472fdf3ff,network=Network(bae9cfd5-4f4e-4f4a-a166-c94f8d295a86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7a25def-13')
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:57:76,bridge_name='br-int',has_traffic_filtering=True,id=b0ba9e9d-e4ac-4368-8d79-dff472bb46b9,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ba9e9d-e4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:57:76,bridge_name='br-int',has_traffic_filtering=True,id=b0ba9e9d-e4ac-4368-8d79-dff472bb46b9,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ba9e9d-e4') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0ba9e9d-e4, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11c0b327-dc3f-42e4-8f6d-9a1229cf77fb) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: INFO os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:57:76,bridge_name='br-int',has_traffic_filtering=True,id=b0ba9e9d-e4ac-4368-8d79-dff472bb46b9,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0ba9e9d-e4')
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T13:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1920304205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1920304205',id=18,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA/aHu4V2Mo6xI3TSZlzS38zX+P+XE3qtX7+LmNEwY3C/UW4ZNAPtngM4A8ikHRmI/lBYl3aLo8dxC9rpQVdxufFtQuUxzczmGamOc73RvJrqVb+9+cgfLKzD7wvz2LPw==',key_name='tempest-keypair-1308372715',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d76574df8c4c1e975d3d75bcefe011',ramdisk_id='',reservation_id='r-3zbvvv06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-983743977',owner_user_name='tempest-TaggedBootDevicesTest_v242-983743977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='033f984ade194139a635d47665a80928',uuid=84b6410e-14ea-49ad-98f0-32933047ba58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converting VIF {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:f0:31,bridge_name='br-int',has_traffic_filtering=True,id=149f6e1a-4425-4a14-9c12-2515d0a56efe,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149f6e1a-44') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f0:31,bridge_name='br-int',has_traffic_filtering=True,id=149f6e1a-4425-4a14-9c12-2515d0a56efe,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149f6e1a-44') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap149f6e1a-44, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7be3225e-7992-4a5d-b7c9-9442d739a968) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:31 user nova-compute[75071]: INFO os_vif [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:f0:31,bridge_name='br-int',has_traffic_filtering=True,id=149f6e1a-4425-4a14-9c12-2515d0a56efe,network=Network(dc761000-38da-4b1a-92a3-d30e7b93a61c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149f6e1a-44')
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvYUPSLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd43c2f4-4e43-4aa3-b162-41f9e562832c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]: iSNS:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]: STATIC:
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: FIRMWARE:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:25:31 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:25:31 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52acc08-c88b-41c6-8fde-ea3ce07ad69b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-2ddafa0f-75cc-434f-8a5f-164201102d76 for instance with vm_state active and task_state deleting.
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-unplugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-bda0814a-ec11-4f93-93ec-6d58a49e0776 for instance with vm_state active and task_state deleting.
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-unplugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 for instance with vm_state active and task_state deleting.
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-unplugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-unplugged-149f6e1a-4425-4a14-9c12-2515d0a56efe for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "84b6410e-14ea-49ad-98f0-32933047ba58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] No waiting events found dispatching network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received unexpected event network-vif-plugged-149f6e1a-4425-4a14-9c12-2515d0a56efe for instance with vm_state active and task_state deleting.
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-vif-unplugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] No waiting events found dispatching network-vif-unplugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-vif-unplugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Acquiring lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] No waiting events found dispatching network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING nova.compute.manager [req-4243a627-2cc5-4031-895e-97607d31f43f req-661f1bbd-f593-4100-93c0-63193a3e8482 service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received unexpected event network-vif-plugged-ebfc46f1-0f4a-48af-93ce-d09eb4910676 for instance with vm_state active and task_state deleting.
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[578dbf58-0ac2-456b-93fe-5a63e6915629]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e38700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504'): ({'sdg'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Removing single pathed devices sdg {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f43df7e-6284-44c2-837e-ef7d0cee3fd0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74bbd1d-eede-48f2-a412-f167bfa52b8c]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Flushing IO for device /dev/sdg {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba494056-76b5-4a79-b6d1-c11d0cbeb48e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd26afa-5e79-45fa-85b9-eb0b54f1d350]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c59eb0-ec07-4623-ab43-f1b5178f5e97]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e63042-9956-467b-950c-c9677879fbd8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260]
Nov 29 13:25:31 user nova-compute[75071]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504, portal: 172.16.0.220,3260] successful.
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caccff51-1c91-429a-83a0-b0be3d846504 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0dbef6-df77-4a49-89ae-d7910e5bb5aa]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== disconnect_volume: return (348ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OITiLtgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53749b71-de70-4012-b1bf-9fa372e47288]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]: iSNS:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]: STATIC:
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: FIRMWARE:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:25:31 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:25:31 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[385dcf03-3f45-4d5b-a848-e4481fe1398f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[003da3a9-75e6-49d4-a64d-df300306855d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d53010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa'): ({'sdh'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Removing single pathed devices sdh {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:25:31 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Took 0.75 seconds to deallocate network for instance.
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[744320df-0d65-42d7-8cd5-f2eb68cc973f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caeed6f-db22-40c7-8ee6-c7b2a92e8319]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Flushing IO for device /dev/sdh {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aef3e72-2e50-4659-a7f7-7b9f0a984e75]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b8bfa-ec5e-4014-afcd-05c6f84b78d8]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab263376-458d-4a49-a6fc-ed13069ffc47]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29dc33-e6c7-4529-9c67-c6423895ff0e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260]
Nov 29 13:25:31 user nova-compute[75071]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa, portal: 172.16.0.220,3260] successful.
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda981bc-9acd-492b-822f-f092b6df41aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c75ef42-c426-48e1-8f75-36f2c3ca552d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== disconnect_volume: return (327ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lSLoPCxX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:25:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad1a610-4e82-440b-b55b-bbf970b5abcf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]: iSNS:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]: STATIC:
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb
Nov 29 13:25:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:25:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:25:31 user nova-compute[75071]: FIRMWARE:
Nov 29 13:25:31 user nova-compute[75071]: No targets found.
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:25:31 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:25:31 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64e662-9935-4fe6-bb0a-1e91b5239f7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5543ba0-1fc4-4aaf-be55-f1fa3d1c5f77]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb (non-flash)
Nov 29 13:25:31 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:25:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d53010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb'): ({'sdi'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Removing single pathed devices sdi {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2057d1b4-7b2e-43ca-80f3-0f74eb81e27d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72da81b-f17d-4e4a-9f93-0481fadc3bf2]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Flushing IO for device /dev/sdi {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad16668-0504-4c13-b439-adbced89b295]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Deleted allocations for instance 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fa49a5-af27-4fef-ac59-c6085454f546]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] SCSI volumes sdi have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756dca0-93c1-483e-b5ea-dd2677e51c84]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e00115e-fcc6-4353-925e-bf095b52c33c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260]
Nov 29 13:25:32 user nova-compute[75071]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb, portal: 172.16.0.220,3260] successful.
Nov 29 13:25:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59596be-1f1f-40ad-b2aa-02f5a25a35fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b362d-0485-43ef-b6e9-8fe4b5a0d385]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] <== disconnect_volume: return (327ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:25:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Deleting instance files /opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58_del
Nov 29 13:25:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Deletion of /opt/stack/data/nova/instances/84b6410e-14ea-49ad-98f0-32933047ba58_del complete
Nov 29 13:25:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1f32d9fa-c8e9-4af9-ad71-150199c79db5 tempest-AttachSCSIVolumeTestJSON-2028645872 tempest-AttachSCSIVolumeTestJSON-2028645872-project-member] Lock "03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:32 user nova-compute[75071]: INFO nova.compute.manager [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Took 3.80 seconds to destroy the instance on the hypervisor.
Nov 29 13:25:32 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:25:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-7665ce34-f183-4d70-a870-047237fe4514 req-5a5d61fa-1b35-4ec2-a070-6c3d33d2f60a service nova] [instance: 03c7f70d-af4e-48cc-ba4e-a0f0a3d8428b] Received event network-vif-deleted-ebfc46f1-0f4a-48af-93ce-d09eb4910676 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-deleted-f7a25def-1380-46fc-9fcc-ced472fdf3ff {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:35 user nova-compute[75071]: INFO nova.compute.manager [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Neutron deleted interface f7a25def-1380-46fc-9fcc-ced472fdf3ff; detaching it from the instance and deleting it from the info cache
Nov 29 13:25:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "address": "fa:16:3e:24:0a:e7", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbda0814a-ec", "ovs_interfaceid": "bda0814a-ec11-4f93-93ec-6d58a49e0776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Detach interface failed, port_id=f7a25def-1380-46fc-9fcc-ced472fdf3ff, reason: Instance 84b6410e-14ea-49ad-98f0-32933047ba58 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:25:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-deleted-bda0814a-ec11-4f93-93ec-6d58a49e0776 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:35 user nova-compute[75071]: INFO nova.compute.manager [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Neutron deleted interface bda0814a-ec11-4f93-93ec-6d58a49e0776; detaching it from the instance and deleting it from the info cache
Nov 29 13:25:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [{"id": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "address": "fa:16:3e:e7:e3:db", "network": {"id": "a76d1c25-afe7-49b0-bd21-fa2ac6d26784", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1958384325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12a2c809-c5", "ovs_interfaceid": "12a2c809-c585-4ef3-b1ce-17bd3df2bbbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "address": "fa:16:3e:7d:47:71", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b2e7ffe-95", "ovs_interfaceid": "4b2e7ffe-9534-4809-9de9-63a997b0da9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ddafa0f-75cc-434f-8a5f-164201102d76", "address": "fa:16:3e:77:cb:70", "network": {"id": "bae9cfd5-4f4e-4f4a-a166-c94f8d295a86", "bridge": "br-int", "label": "tempest-device-tagging-net1-485505416", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ddafa0f-75", "ovs_interfaceid": "2ddafa0f-75cc-434f-8a5f-164201102d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "address": "fa:16:3e:16:57:76", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ba9e9d-e4", "ovs_interfaceid": "b0ba9e9d-e4ac-4368-8d79-dff472bb46b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "address": "fa:16:3e:78:f0:31", "network": {"id": "dc761000-38da-4b1a-92a3-d30e7b93a61c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1764748974", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d6d76574df8c4c1e975d3d75bcefe011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149f6e1a-44", "ovs_interfaceid": "149f6e1a-4425-4a14-9c12-2515d0a56efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-275b9514-2ead-4596-b543-d391a027ed62 req-1d8f67ab-75de-4c51-a3a2-a4de97056120 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Detach interface failed, port_id=bda0814a-ec11-4f93-93ec-6d58a49e0776, reason: Instance 84b6410e-14ea-49ad-98f0-32933047ba58 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:25:35 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:36 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Took 3.88 seconds to deallocate network for instance.
Nov 29 13:25:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-471bf0af-6f14-4009-9502-420734e978c1 req-d212bae0-50ef-45a6-94d7-2081a7961f80 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-deleted-12a2c809-c585-4ef3-b1ce-17bd3df2bbbd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-471bf0af-6f14-4009-9502-420734e978c1 req-d212bae0-50ef-45a6-94d7-2081a7961f80 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-deleted-b0ba9e9d-e4ac-4368-8d79-dff472bb46b9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-471bf0af-6f14-4009-9502-420734e978c1 req-d212bae0-50ef-45a6-94d7-2081a7961f80 service nova] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Received event network-vif-deleted-149f6e1a-4425-4a14-9c12-2515d0a56efe {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:38 user nova-compute[75071]: INFO nova.compute.manager [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] [instance: 84b6410e-14ea-49ad-98f0-32933047ba58] Took 2.55 seconds to detach 3 volumes for instance.
Nov 29 13:25:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:38 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:38 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:38 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Deleted allocations for instance 84b6410e-14ea-49ad-98f0-32933047ba58
Nov 29 13:25:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c5c6cf09-89d7-400f-914e-cc3873f90fb4 tempest-TaggedBootDevicesTest_v242-983743977 tempest-TaggedBootDevicesTest_v242-983743977-project-member] Lock "84b6410e-14ea-49ad-98f0-32933047ba58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.720s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:25:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:43 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:25:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7606MB free_disk=25.176807403564453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6935d835-c98f-4355-8031-4436125925f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance cf99d96e-7767-4a34-a4e9-f1a970506058 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:25:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:25:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:25:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:25:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:25:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:25:54 user nova-compute[75071]: INFO nova.compute.claims [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Claim successful on node user
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:25:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:25:54 user nova-compute[75071]: INFO nova.virt.block_device [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Booting with blank volume at /dev/vda
Nov 29 13:25:54 user nova-compute[75071]: DEBUG nova.policy [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f902428dcca045ffa81dbd8fd53048b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd1e8292884439b8d49dd698bf812e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:25:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Successfully created port: 45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:25:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Successfully updated port: 45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:25:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:25:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:25:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-changed-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Refreshing instance network info cache due to event network-changed-45921a18-24fc-47db-a80d-93de497a66e8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] Acquiring lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating instance_info_cache with network_info: [{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance network_info: |[{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] Acquired lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Refreshing network info cache for port 45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updated VIF entry in instance network info cache for port 45921a18-24fc-47db-a80d-93de497a66e8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating instance_info_cache with network_info: [{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:25:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33f2496e-1dc0-4cfd-b02c-aa5c38f1f803 req-7f46c716-12e6-4668-94d9-c1e6756070eb service nova] Releasing lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:25:58 user nova-compute[75071]: INFO nova.compute.claims [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Claim successful on node user
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:25:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.policy [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d54f49fa05c4317bb667c1877cb466a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50f58750d5b84ed9847af078c31c0004', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:25:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Creating image(s)
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "/opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "/opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "5726c0f355f8c7083d722a2658dbee3dbf53b0c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "5726c0f355f8c7083d722a2658dbee3dbf53b0c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:25:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:25:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Successfully created port: 207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:25:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.part --force-share --output=json" returned: 0 in 0.226s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:25:59 user nova-compute[75071]: DEBUG nova.virt.images [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] 9e69ac14-d734-4bf7-861d-261ec51390a7 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:25:59 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:25:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.part /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.part /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.converted" returned: 0 in 0.631s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Successfully updated port: 207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquired lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing instance network info cache due to event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] Acquiring lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG os_brick.utils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9ac91d-d854-45df-be94-3eb309770289]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b81e4b-75f5-4308-97f9-a2221563f466]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "5726c0f355f8c7083d722a2658dbee3dbf53b0c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.559s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[24142a6b-55c9-4444-9fac-d2731cd53a9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c55a22f-6fe9-4649-828d-22b3a68dbd77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:26:00 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a3d51b-f7a1-4d8c-9809-5931de01b4fa]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG os_brick.utils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating existing volume attachment record: 52aa2196-8f57-482d-a021-ba3bf22a91c0 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0 --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "5726c0f355f8c7083d722a2658dbee3dbf53b0c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "5726c0f355f8c7083d722a2658dbee3dbf53b0c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Releasing lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance network_info: |[{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] Acquired lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0 --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0,backing_fmt=raw /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0,backing_fmt=raw /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk 1073741824" returned: 0 in 0.065s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "5726c0f355f8c7083d722a2658dbee3dbf53b0c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updated VIF entry in instance network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-319b9a5f-7612-4d71-ae0a-adabbc9502b7 req-e6d53587-b970-4b09-8288-e8508b4e0dd5 service nova] Releasing lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Cannot resize image /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Ensure instance console log exists: /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Start _get_guest_xml network_info=[{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:25:55Z,direct_url=<?>,disk_format='qcow2',id=9e69ac14-d734-4bf7-861d-261ec51390a7,min_disk=0,min_ram=0,name='tempest-scenario-img--206727931',owner='50f58750d5b84ed9847af078c31c0004',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:25:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '9e69ac14-d734-4bf7-861d-261ec51390a7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:26:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:25:55Z,direct_url=<?>,disk_format='qcow2',id=9e69ac14-d734-4bf7-861d-261ec51390a7,min_disk=0,min_ram=0,name='tempest-scenario-img--206727931',owner='50f58750d5b84ed9847af078c31c0004',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:25:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051012330',display_name='tempest-TestMinimumBasicScenario-server-2051012330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051012330',id=22,image_ref='9e69ac14-d734-4bf7-861d-261ec51390a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeu9GgFSPa6/K+kij4tPOwKDOANbk5u8kY50Refd/RxJ6Ik5+Xn/ONaS5bGXhZEv9OiOh1ALtAe8g0R6P4mubVvN9qq+QEi7+Rpkxhjx0LoI9rHIG+YyMCeeqY5+kBdmQ==',key_name='tempest-TestMinimumBasicScenario-1430741871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-9c10ji5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e69ac14-d734-4bf7-861d-261ec51390a7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:25:59Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=0c6a1702-5e65-4648-915d-2186ca6fc54c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6c:97,bridge_name='br-int',has_traffic_filtering=True,id=207bfd05-1208-4348-b44f-a4804aaedf3a,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207bfd05-12') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c6a1702-5e65-4648-915d-2186ca6fc54c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:26:01 user nova-compute[75071]:   <uuid>0c6a1702-5e65-4648-915d-2186ca6fc54c</uuid>
Nov 29 13:26:01 user nova-compute[75071]:   <name>instance-00000016</name>
Nov 29 13:26:01 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:26:01 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:26:01 user nova-compute[75071]:   <metadata>
Nov 29 13:26:01 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:26:01 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:26:01 user nova-compute[75071]:       <nova:name>tempest-TestMinimumBasicScenario-server-2051012330</nova:name>
Nov 29 13:26:01 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:26:01</nova:creationTime>
Nov 29 13:26:01 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:26:01 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:26:01 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:26:01 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:26:01 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:26:01 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:26:01 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:26:01 user nova-compute[75071]:       <nova:owner>
Nov 29 13:26:01 user nova-compute[75071]:         <nova:user uuid="0d54f49fa05c4317bb667c1877cb466a">tempest-TestMinimumBasicScenario-182325840-project-member</nova:user>
Nov 29 13:26:01 user nova-compute[75071]:         <nova:project uuid="50f58750d5b84ed9847af078c31c0004">tempest-TestMinimumBasicScenario-182325840</nova:project>
Nov 29 13:26:01 user nova-compute[75071]:       </nova:owner>
Nov 29 13:26:01 user nova-compute[75071]:       <nova:root type="image" uuid="9e69ac14-d734-4bf7-861d-261ec51390a7"/>
Nov 29 13:26:01 user nova-compute[75071]:       <nova:ports>
Nov 29 13:26:01 user nova-compute[75071]:         <nova:port uuid="207bfd05-1208-4348-b44f-a4804aaedf3a">
Nov 29 13:26:01 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 13:26:01 user nova-compute[75071]:         </nova:port>
Nov 29 13:26:01 user nova-compute[75071]:       </nova:ports>
Nov 29 13:26:01 user nova-compute[75071]:     </nova:instance>
Nov 29 13:26:01 user nova-compute[75071]:   </metadata>
Nov 29 13:26:01 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:26:01 user nova-compute[75071]:     <system>
Nov 29 13:26:01 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:26:01 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:26:01 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:26:01 user nova-compute[75071]:       <entry name="serial">0c6a1702-5e65-4648-915d-2186ca6fc54c</entry>
Nov 29 13:26:01 user nova-compute[75071]:       <entry name="uuid">0c6a1702-5e65-4648-915d-2186ca6fc54c</entry>
Nov 29 13:26:01 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:26:01 user nova-compute[75071]:     </system>
Nov 29 13:26:01 user nova-compute[75071]:   </sysinfo>
Nov 29 13:26:01 user nova-compute[75071]:   <os>
Nov 29 13:26:01 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:26:01 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:26:01 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:26:01 user nova-compute[75071]:   </os>
Nov 29 13:26:01 user nova-compute[75071]:   <features>
Nov 29 13:26:01 user nova-compute[75071]:     <acpi/>
Nov 29 13:26:01 user nova-compute[75071]:     <apic/>
Nov 29 13:26:01 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:26:01 user nova-compute[75071]:   </features>
Nov 29 13:26:01 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:26:01 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:26:01 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:26:01 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:26:01 user nova-compute[75071]:   </clock>
Nov 29 13:26:01 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:26:01 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:26:01 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:26:01 user nova-compute[75071]:   </cpu>
Nov 29 13:26:01 user nova-compute[75071]:   <devices>
Nov 29 13:26:01 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:26:01 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:26:01 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk"/>
Nov 29 13:26:01 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:26:01 user nova-compute[75071]:     </disk>
Nov 29 13:26:01 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:26:01 user nova-compute[75071]:       <mac address="fa:16:3e:4f:6c:97"/>
Nov 29 13:26:01 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:26:01 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:26:01 user nova-compute[75071]:       <target dev="tap207bfd05-12"/>
Nov 29 13:26:01 user nova-compute[75071]:     </interface>
Nov 29 13:26:01 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:26:01 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/console.log" append="off"/>
Nov 29 13:26:01 user nova-compute[75071]:     </serial>
Nov 29 13:26:01 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:26:01 user nova-compute[75071]:     <video>
Nov 29 13:26:01 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:26:01 user nova-compute[75071]:     </video>
Nov 29 13:26:01 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:26:01 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:26:01 user nova-compute[75071]:     </rng>
Nov 29 13:26:01 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:26:01 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:26:01 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:26:01 user nova-compute[75071]:     </memballoon>
Nov 29 13:26:01 user nova-compute[75071]:   </devices>
Nov 29 13:26:01 user nova-compute[75071]: </domain>
Nov 29 13:26:01 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051012330',display_name='tempest-TestMinimumBasicScenario-server-2051012330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051012330',id=22,image_ref='9e69ac14-d734-4bf7-861d-261ec51390a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeu9GgFSPa6/K+kij4tPOwKDOANbk5u8kY50Refd/RxJ6Ik5+Xn/ONaS5bGXhZEv9OiOh1ALtAe8g0R6P4mubVvN9qq+QEi7+Rpkxhjx0LoI9rHIG+YyMCeeqY5+kBdmQ==',key_name='tempest-TestMinimumBasicScenario-1430741871',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-9c10ji5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e69ac14-d734-4bf7-861d-261ec51390a7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:25:59Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=0c6a1702-5e65-4648-915d-2186ca6fc54c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6c:97,bridge_name='br-int',has_traffic_filtering=True,id=207bfd05-1208-4348-b44f-a4804aaedf3a,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207bfd05-12') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG os_vif [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6c:97,bridge_name='br-int',has_traffic_filtering=True,id=207bfd05-1208-4348-b44f-a4804aaedf3a,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207bfd05-12') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1eb6d927-8197-5b7c-bf91-d760fd2d4eb4', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap207bfd05-12, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap207bfd05-12, col_values=(('qos', UUID('a1f447da-9b25-406b-8326-01ce67e0ce74')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap207bfd05-12, col_values=(('external_ids', {'iface-id': '207bfd05-1208-4348-b44f-a4804aaedf3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:6c:97', 'vm-uuid': '0c6a1702-5e65-4648-915d-2186ca6fc54c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:01 user nova-compute[75071]: INFO os_vif [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:6c:97,bridge_name='br-int',has_traffic_filtering=True,id=207bfd05-1208-4348-b44f-a4804aaedf3a,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207bfd05-12')
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:26:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No VIF found with MAC fa:16:3e:4f:6c:97, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:26:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-756222e4-182f-4fdd-9c8f-85a80cd404f5 req-c9917f13-fe01-414b-88f0-55955e024031 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-756222e4-182f-4fdd-9c8f-85a80cd404f5 req-c9917f13-fe01-414b-88f0-55955e024031 service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-756222e4-182f-4fdd-9c8f-85a80cd404f5 req-c9917f13-fe01-414b-88f0-55955e024031 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-756222e4-182f-4fdd-9c8f-85a80cd404f5 req-c9917f13-fe01-414b-88f0-55955e024031 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-756222e4-182f-4fdd-9c8f-85a80cd404f5 req-c9917f13-fe01-414b-88f0-55955e024031 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:03 user nova-compute[75071]: WARNING nova.compute.manager [req-756222e4-182f-4fdd-9c8f-85a80cd404f5 req-c9917f13-fe01-414b-88f0-55955e024031 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state building and task_state spawning.
Nov 29 13:26:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:26:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance spawned successfully.
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:05 user nova-compute[75071]: INFO nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-e5807390-7844-4be6-8861-cfd205f426f0 req-e87706c3-55b3-4c4d-ad52-ccc306184f53 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e5807390-7844-4be6-8861-cfd205f426f0 req-e87706c3-55b3-4c4d-ad52-ccc306184f53 service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e5807390-7844-4be6-8861-cfd205f426f0 req-e87706c3-55b3-4c4d-ad52-ccc306184f53 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e5807390-7844-4be6-8861-cfd205f426f0 req-e87706c3-55b3-4c4d-ad52-ccc306184f53 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-e5807390-7844-4be6-8861-cfd205f426f0 req-e87706c3-55b3-4c4d-ad52-ccc306184f53 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:05 user nova-compute[75071]: WARNING nova.compute.manager [req-e5807390-7844-4be6-8861-cfd205f426f0 req-e87706c3-55b3-4c4d-ad52-ccc306184f53 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state building and task_state spawning.
Nov 29 13:26:05 user nova-compute[75071]: INFO nova.compute.manager [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Took 7.16 seconds to build instance.
Nov 29 13:26:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcab7ea7-b70e-4a72-8435-b2c35771b0c5 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:26:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Creating image(s)
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Ensure instance console log exists: /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Start _get_guest_xml network_info=[{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcqzUwCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d', 'attached_at': '', 'detached_at': '', 'volume_id': '8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'serial': '8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '52aa2196-8f57-482d-a021-ba3bf22a91c0', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:26:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcqzUwCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:26:09 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:26:09 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:26:09 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abee4499-dfdc-4a73-8b66-38a7a4232b4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:26:09 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55616e7-acfa-4371-82ec-eb82137a98ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36] added
Nov 29 13:26:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52308e-86bb-4b30-8da2-23be671022b8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9295c2-5372-41a1-8e55-74a047b26ac6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcqzUwCe {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcqzUwCe" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94bb17a-7533-43da-bf38-779551db2713]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcqzUwCe'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71029c92-7b21-49c3-bb2c-ae28edda5cf1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20805445-ab23-4b19-b056-cfb2bfb00371]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7d48e-93ed-476c-809b-51a13beeb926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260]
Nov 29 13:26:09 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260] successful.
Nov 29 13:26:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a271b33f-c1bd-4bed-9367-428082c85181]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbdd631-6f0b-42c9-9cce-e67960635ef2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:26:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:09 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:26:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6e1727-4e00-49d9-9966-815680ed056a]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:26:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcqzUwCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23564336538626537', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564336538626537', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-693445275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-693445275',id=21,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-3r3k8o12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:25:55Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'pci_devices' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:26:10 user nova-compute[75071]:   <uuid>7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d</uuid>
Nov 29 13:26:10 user nova-compute[75071]:   <name>instance-00000015</name>
Nov 29 13:26:10 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:26:10 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:26:10 user nova-compute[75071]:   <metadata>
Nov 29 13:26:10 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:26:10 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:26:10 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-693445275</nova:name>
Nov 29 13:26:10 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:26:09</nova:creationTime>
Nov 29 13:26:10 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:26:10 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:26:10 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:26:10 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:26:10 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:26:10 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:26:10 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:26:10 user nova-compute[75071]:       <nova:owner>
Nov 29 13:26:10 user nova-compute[75071]:         <nova:user uuid="f902428dcca045ffa81dbd8fd53048b6">tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member</nova:user>
Nov 29 13:26:10 user nova-compute[75071]:         <nova:project uuid="ecd1e8292884439b8d49dd698bf812e1">tempest-ServerBootFromVolumeStableRescueTest-398011867</nova:project>
Nov 29 13:26:10 user nova-compute[75071]:       </nova:owner>
Nov 29 13:26:10 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:26:10 user nova-compute[75071]:       <nova:ports>
Nov 29 13:26:10 user nova-compute[75071]:         <nova:port uuid="45921a18-24fc-47db-a80d-93de497a66e8">
Nov 29 13:26:10 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:26:10 user nova-compute[75071]:         </nova:port>
Nov 29 13:26:10 user nova-compute[75071]:       </nova:ports>
Nov 29 13:26:10 user nova-compute[75071]:     </nova:instance>
Nov 29 13:26:10 user nova-compute[75071]:   </metadata>
Nov 29 13:26:10 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:26:10 user nova-compute[75071]:     <system>
Nov 29 13:26:10 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:26:10 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:26:10 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:26:10 user nova-compute[75071]:       <entry name="serial">7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d</entry>
Nov 29 13:26:10 user nova-compute[75071]:       <entry name="uuid">7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d</entry>
Nov 29 13:26:10 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:26:10 user nova-compute[75071]:     </system>
Nov 29 13:26:10 user nova-compute[75071]:   </sysinfo>
Nov 29 13:26:10 user nova-compute[75071]:   <os>
Nov 29 13:26:10 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:26:10 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:26:10 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:26:10 user nova-compute[75071]:   </os>
Nov 29 13:26:10 user nova-compute[75071]:   <features>
Nov 29 13:26:10 user nova-compute[75071]:     <acpi/>
Nov 29 13:26:10 user nova-compute[75071]:     <apic/>
Nov 29 13:26:10 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:26:10 user nova-compute[75071]:   </features>
Nov 29 13:26:10 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:26:10 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:26:10 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:26:10 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:26:10 user nova-compute[75071]:   </clock>
Nov 29 13:26:10 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:26:10 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:26:10 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:26:10 user nova-compute[75071]:   </cpu>
Nov 29 13:26:10 user nova-compute[75071]:   <devices>
Nov 29 13:26:10 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:26:10 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:26:10 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Nov 29 13:26:10 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:26:10 user nova-compute[75071]:       <serial>8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36</serial>
Nov 29 13:26:10 user nova-compute[75071]:     </disk>
Nov 29 13:26:10 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:26:10 user nova-compute[75071]:       <mac address="fa:16:3e:bb:24:2b"/>
Nov 29 13:26:10 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:26:10 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:26:10 user nova-compute[75071]:       <target dev="tap45921a18-24"/>
Nov 29 13:26:10 user nova-compute[75071]:     </interface>
Nov 29 13:26:10 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:26:10 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/console.log" append="off"/>
Nov 29 13:26:10 user nova-compute[75071]:     </serial>
Nov 29 13:26:10 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:26:10 user nova-compute[75071]:     <video>
Nov 29 13:26:10 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:26:10 user nova-compute[75071]:     </video>
Nov 29 13:26:10 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:26:10 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:26:10 user nova-compute[75071]:     </rng>
Nov 29 13:26:10 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:26:10 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:26:10 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:26:10 user nova-compute[75071]:     </memballoon>
Nov 29 13:26:10 user nova-compute[75071]:   </devices>
Nov 29 13:26:10 user nova-compute[75071]: </domain>
Nov 29 13:26:10 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-693445275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-693445275',id=21,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-3r3k8o12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:25:55Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG os_vif [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1655e4bb-488b-52bc-9906-5aac3135d138', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45921a18-24, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45921a18-24, col_values=(('qos', UUID('7ddbe543-d64b-4efe-a8a1-4227317a129f')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45921a18-24, col_values=(('external_ids', {'iface-id': '45921a18-24fc-47db-a80d-93de497a66e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:24:2b', 'vm-uuid': '7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:10 user nova-compute[75071]: INFO os_vif [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24')
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:26:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No VIF found with MAC fa:16:3e:bb:24:2b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-7203fb48-9917-4f1e-9a29-0e64f7bc3a88 req-131b70a9-2a30-4206-8c8f-bbda050108f6 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7203fb48-9917-4f1e-9a29-0e64f7bc3a88 req-131b70a9-2a30-4206-8c8f-bbda050108f6 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7203fb48-9917-4f1e-9a29-0e64f7bc3a88 req-131b70a9-2a30-4206-8c8f-bbda050108f6 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7203fb48-9917-4f1e-9a29-0e64f7bc3a88 req-131b70a9-2a30-4206-8c8f-bbda050108f6 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-7203fb48-9917-4f1e-9a29-0e64f7bc3a88 req-131b70a9-2a30-4206-8c8f-bbda050108f6 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:12 user nova-compute[75071]: WARNING nova.compute.manager [req-7203fb48-9917-4f1e-9a29-0e64f7bc3a88 req-131b70a9-2a30-4206-8c8f-bbda050108f6 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state building and task_state spawning.
Nov 29 13:26:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:26:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance spawned successfully.
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:14 user nova-compute[75071]: INFO nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:26:14 user nova-compute[75071]: INFO nova.compute.manager [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Took 20.20 seconds to build instance.
Nov 29 13:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1d7f010-dcf7-4037-923b-e6dc18381e07 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.287s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-cad65acd-7654-4e81-b39c-bf23184698a9 req-d8805864-22df-41c4-956f-691b4c02092a service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cad65acd-7654-4e81-b39c-bf23184698a9 req-d8805864-22df-41c4-956f-691b4c02092a service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cad65acd-7654-4e81-b39c-bf23184698a9 req-d8805864-22df-41c4-956f-691b4c02092a service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cad65acd-7654-4e81-b39c-bf23184698a9 req-d8805864-22df-41c4-956f-691b4c02092a service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-cad65acd-7654-4e81-b39c-bf23184698a9 req-d8805864-22df-41c4-956f-691b4c02092a service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:14 user nova-compute[75071]: WARNING nova.compute.manager [req-cad65acd-7654-4e81-b39c-bf23184698a9 req-d8805864-22df-41c4-956f-691b4c02092a service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state active and task_state None.
Nov 29 13:26:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received event network-changed-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Refreshing instance network info cache due to event network-changed-9fb1930d-7905-4c4d-a9d0-c427ea9833d1. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:26:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] Acquiring lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:26:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] Acquired lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:26:30 user nova-compute[75071]: DEBUG nova.network.neutron [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Refreshing network info cache for port 9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "cf99d96e-7767-4a34-a4e9-f1a970506058" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:31 user nova-compute[75071]: INFO nova.compute.manager [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Terminating instance
Nov 29 13:26:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Updated VIF entry in instance network info cache for port 9fb1930d-7905-4c4d-a9d0-c427ea9833d1. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Updating instance_info_cache with network_info: [{"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0ca648b5-ebd8-4f9f-b45c-2f12e3586ec6 req-7eba4eca-de0e-43fc-a3d5-836e97b69dcf service nova] Releasing lock "refresh_cache-cf99d96e-7767-4a34-a4e9-f1a970506058" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Instance destroyed successfully.
Nov 29 13:26:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'resources' on Instance uuid cf99d96e-7767-4a34-a4e9-f1a970506058 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:24:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1488978385',display_name='tempest-AttachVolumeNegativeTest-server-1488978385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1488978385',id=19,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOroZizhQPJiELqRBWTMZtNhCs5jx1CdrZE4gidC1iaQhnQy8530qYsEktQqeKLgKG3r8ocNc3lKwBGBJA06utlgcstEUF5GB4uwq9+VN68qRySMwHogIAXRhEjoqvJ97A==',key_name='tempest-keypair-1080363194',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-8bfdaz3h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=cf99d96e-7767-4a34-a4e9-f1a970506058,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "address": "fa:16:3e:31:ab:db", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb1930d-79", "ovs_interfaceid": "9fb1930d-7905-4c4d-a9d0-c427ea9833d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:db,bridge_name='br-int',has_traffic_filtering=True,id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb1930d-79') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG os_vif [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:db,bridge_name='br-int',has_traffic_filtering=True,id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb1930d-79') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fb1930d-79, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7342d72-5e58-414c-bc7e-865c4c8cfb41) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:31 user nova-compute[75071]: INFO os_vif [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:db,bridge_name='br-int',has_traffic_filtering=True,id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb1930d-79')
Nov 29 13:26:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Deleting instance files /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058_del
Nov 29 13:26:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Deletion of /opt/stack/data/nova/instances/cf99d96e-7767-4a34-a4e9-f1a970506058_del complete
Nov 29 13:26:32 user nova-compute[75071]: INFO nova.compute.manager [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:32 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Took 0.66 seconds to deallocate network for instance.
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-578285e7-2dd3-4ca5-9f7c-50bea07b4b54 req-50658934-7830-4049-8e62-fedeb0247dc9 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received event network-vif-deleted-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:32 user nova-compute[75071]: INFO nova.compute.manager [req-578285e7-2dd3-4ca5-9f7c-50bea07b4b54 req-50658934-7830-4049-8e62-fedeb0247dc9 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Neutron deleted interface 9fb1930d-7905-4c4d-a9d0-c427ea9833d1; detaching it from the instance and deleting it from the info cache
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-578285e7-2dd3-4ca5-9f7c-50bea07b4b54 req-50658934-7830-4049-8e62-fedeb0247dc9 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-578285e7-2dd3-4ca5-9f7c-50bea07b4b54 req-50658934-7830-4049-8e62-fedeb0247dc9 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Detach interface failed, port_id=9fb1930d-7905-4c4d-a9d0-c427ea9833d1, reason: Instance cf99d96e-7767-4a34-a4e9-f1a970506058 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received event network-vif-unplugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] Acquiring lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] No waiting events found dispatching network-vif-unplugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:32 user nova-compute[75071]: WARNING nova.compute.manager [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received unexpected event network-vif-unplugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 for instance with vm_state deleted and task_state None.
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received event network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] Acquiring lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] No waiting events found dispatching network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:32 user nova-compute[75071]: WARNING nova.compute.manager [req-fcc2b261-0757-4ee5-96a9-843e7afcfa16 req-bf793181-5e3d-4264-8067-1de9ef864c25 service nova] [instance: cf99d96e-7767-4a34-a4e9-f1a970506058] Received unexpected event network-vif-plugged-9fb1930d-7905-4c4d-a9d0-c427ea9833d1 for instance with vm_state deleted and task_state None.
Nov 29 13:26:33 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:26:33 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:26:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:33 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Deleted allocations for instance cf99d96e-7767-4a34-a4e9-f1a970506058
Nov 29 13:26:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:33 user nova-compute[75071]: INFO nova.compute.manager [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Detaching volume 2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:26:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9cf3f717-0748-453c-8d94-6b2360d4f3f3 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "cf99d96e-7767-4a34-a4e9-f1a970506058" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:33 user nova-compute[75071]: INFO nova.virt.block_device [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Attempting to driver detach volume 2ecf8b34-b51c-497c-b64a-6ad3229a18ef from mountpoint /dev/vdb
Nov 29 13:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Attempting to detach device vdb from instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:26:33 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:26:33 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:26:33 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:26:33 user nova-compute[75071]:   <serial>2ecf8b34-b51c-497c-b64a-6ad3229a18ef</serial>
Nov 29 13:26:33 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:26:33 user nova-compute[75071]: </disk>
Nov 29 13:26:33 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:26:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully detached device vdb from instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 from the persistent domain config.
Nov 29 13:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:26:33 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:26:33 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:26:33 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:26:33 user nova-compute[75071]:   <serial>2ecf8b34-b51c-497c-b64a-6ad3229a18ef</serial>
Nov 29 13:26:33 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:26:33 user nova-compute[75071]: </disk>
Nov 29 13:26:33 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:35 user nova-compute[75071]: INFO nova.compute.manager [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Terminating instance
Nov 29 13:26:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-64bfad11-3cb8-4f46-8119-c0a24e07dd96 req-cd5efd42-6d81-4d6a-a278-9718ff3bfe86 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received event network-vif-unplugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64bfad11-3cb8-4f46-8119-c0a24e07dd96 req-cd5efd42-6d81-4d6a-a278-9718ff3bfe86 service nova] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64bfad11-3cb8-4f46-8119-c0a24e07dd96 req-cd5efd42-6d81-4d6a-a278-9718ff3bfe86 service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64bfad11-3cb8-4f46-8119-c0a24e07dd96 req-cd5efd42-6d81-4d6a-a278-9718ff3bfe86 service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-64bfad11-3cb8-4f46-8119-c0a24e07dd96 req-cd5efd42-6d81-4d6a-a278-9718ff3bfe86 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] No waiting events found dispatching network-vif-unplugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-64bfad11-3cb8-4f46-8119-c0a24e07dd96 req-cd5efd42-6d81-4d6a-a278-9718ff3bfe86 service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received event network-vif-unplugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:26:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Instance destroyed successfully.
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lazy-loading 'resources' on Instance uuid 945db3bb-5653-48f8-9c5f-2be1984e3cd2 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-365256680',display_name='tempest-ServersNegativeTestJSON-server-365256680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-365256680',id=1,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a7845e453c40d59a3fc56db2d3beb0',ramdisk_id='',reservation_id='r-ayba00sx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-308617736',owner_user_name='tempest-ServersNegativeTestJSON-308617736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:06Z,user_data=None,user_id='d83bac00dc8a40559ff4b0f0673c79a0',uuid=945db3bb-5653-48f8-9c5f-2be1984e3cd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converting VIF {"id": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "address": "fa:16:3e:ad:e6:d3", "network": {"id": "0efb47b2-7d3c-4923-a934-3d1d682ffc3c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-451154302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a7845e453c40d59a3fc56db2d3beb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap166a8bc2-c1", "ovs_interfaceid": "166a8bc2-c197-4ecc-a2f8-e3bbe84683e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:e6:d3,bridge_name='br-int',has_traffic_filtering=True,id=166a8bc2-c197-4ecc-a2f8-e3bbe84683e9,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a8bc2-c1') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG os_vif [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:e6:d3,bridge_name='br-int',has_traffic_filtering=True,id=166a8bc2-c197-4ecc-a2f8-e3bbe84683e9,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a8bc2-c1') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap166a8bc2-c1, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62bd8f81-96b2-4793-a430-656fedd6da8f) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:36 user nova-compute[75071]: INFO os_vif [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:e6:d3,bridge_name='br-int',has_traffic_filtering=True,id=166a8bc2-c197-4ecc-a2f8-e3bbe84683e9,network=Network(0efb47b2-7d3c-4923-a934-3d1d682ffc3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap166a8bc2-c1')
Nov 29 13:26:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Deleting instance files /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2_del
Nov 29 13:26:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Deletion of /opt/stack/data/nova/instances/945db3bb-5653-48f8-9c5f-2be1984e3cd2_del complete
Nov 29 13:26:36 user nova-compute[75071]: INFO nova.compute.manager [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 13:26:36 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:36 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Took 0.45 seconds to deallocate network for instance.
Nov 29 13:26:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c0b32679-e0fe-404d-b3f4-33ef055b0a75 req-f6c4b0b6-aa94-4477-b0bc-623d0659d91f service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received event network-vif-deleted-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:37 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Deleted allocations for instance 945db3bb-5653-48f8-9c5f-2be1984e3cd2
Nov 29 13:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2618979b-0d4c-4c64-91af-440427f06d39 tempest-ServersNegativeTestJSON-308617736 tempest-ServersNegativeTestJSON-308617736-project-member] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-92cd7151-fdea-4ca6-a99d-799ff0eef95d req-72cd62de-22f0-419c-9312-681cefa93acd service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received event network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-92cd7151-fdea-4ca6-a99d-799ff0eef95d req-72cd62de-22f0-419c-9312-681cefa93acd service nova] Acquiring lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-92cd7151-fdea-4ca6-a99d-799ff0eef95d req-72cd62de-22f0-419c-9312-681cefa93acd service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-92cd7151-fdea-4ca6-a99d-799ff0eef95d req-72cd62de-22f0-419c-9312-681cefa93acd service nova] Lock "945db3bb-5653-48f8-9c5f-2be1984e3cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-92cd7151-fdea-4ca6-a99d-799ff0eef95d req-72cd62de-22f0-419c-9312-681cefa93acd service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] No waiting events found dispatching network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:37 user nova-compute[75071]: WARNING nova.compute.manager [req-92cd7151-fdea-4ca6-a99d-799ff0eef95d req-72cd62de-22f0-419c-9312-681cefa93acd service nova] [instance: 945db3bb-5653-48f8-9c5f-2be1984e3cd2] Received unexpected event network-vif-plugged-166a8bc2-c197-4ecc-a2f8-e3bbe84683e9 for instance with vm_state deleted and task_state None.
Nov 29 13:26:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "6935d835-c98f-4355-8031-4436125925f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:39 user nova-compute[75071]: INFO nova.compute.manager [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Terminating instance
Nov 29 13:26:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Instance destroyed successfully.
Nov 29 13:26:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lazy-loading 'resources' on Instance uuid 6935d835-c98f-4355-8031-4436125925f1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2016764760',display_name='tempest-ServerActionsTestOtherB-server-2016764760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2016764760',id=3,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR46FlctU9soHMWUAAXgDascaaputMFxYY4igUy0vvpy+sp8Eo48+Qi+9RAzHAawiLejn6Huqf9UPehFWaFrRpDoooo41R1m0VPLFyNRMTY6BZvFB665ObvJfx9z0N9SQ==',key_name='tempest-keypair-1565236952',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:24:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42978586ae934e319e9848de833d9877',ramdisk_id='',reservation_id='r-y0vg96ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1138605091',owner_user_name='tempest-ServerActionsTestOtherB-1138605091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41649c13883b4d01a13a22c529f9bc6f',uuid=6935d835-c98f-4355-8031-4436125925f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converting VIF {"id": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "address": "fa:16:3e:92:79:29", "network": {"id": "fcb11aa6-37e3-4f5a-9307-a894a790b343", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1449639590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42978586ae934e319e9848de833d9877", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d0cfed-e7", "ovs_interfaceid": "10d0cfed-e70a-4d6e-b80c-75e2376fc0cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_vif [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10d0cfed-e7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=041ad235-12c1-4dcc-b2a8-daea73a06fab) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:40 user nova-compute[75071]: INFO os_vif [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:79:29,bridge_name='br-int',has_traffic_filtering=True,id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd,network=Network(fcb11aa6-37e3-4f5a-9307-a894a790b343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d0cfed-e7')
Nov 29 13:26:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYSqnbVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:26:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78cad9c-44e6-4b69-afee-90d7e4c98410]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:26:40 user nova-compute[75071]: No targets found.
Nov 29 13:26:40 user nova-compute[75071]: iSNS:
Nov 29 13:26:40 user nova-compute[75071]: No targets found.
Nov 29 13:26:40 user nova-compute[75071]: STATIC:
Nov 29 13:26:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:26:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:26:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:26:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a
Nov 29 13:26:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:26:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:26:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:26:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:26:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:26:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:26:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:26:40 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:26:40 user nova-compute[75071]: FIRMWARE:
Nov 29 13:26:40 user nova-compute[75071]: No targets found.
Nov 29 13:26:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:26:40 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:26:40 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c01879-e9bb-4d6c-a827-0ad3b6f67e34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5566293-9051-4535-92cd-0f81235cf5b1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:40 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:26:40 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:40 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:26:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:40 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a (non-flash)
Nov 29 13:26:40 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:40 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:26:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e19c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac7fdac-9571-4c44-a9d4-23a8bbf71664]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ff69d-4db1-4be1-9266-2fd43fdf7814]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f0b32-322b-41f8-b926-ee6328d8d1dc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:26:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90a6212-5053-4b1b-8d97-a2a35c28ab18]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ec5d76-35cf-4227-8c4b-b9549d07957c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac963df-c70d-458d-ad0f-3fbaca37c26a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260]
Nov 29 13:26:41 user nova-compute[75071]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a, portal: 172.16.0.220,3260] successful.
Nov 29 13:26:41 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:789d9c7e-beb3-4dd9-9a2d-f47aaf07474a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f70d0b9-4911-4319-b10a-88eed10e5500]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] <== disconnect_volume: return (327ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:26:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Deleting instance files /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1_del
Nov 29 13:26:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Deletion of /opt/stack/data/nova/instances/6935d835-c98f-4355-8031-4436125925f1_del complete
Nov 29 13:26:41 user nova-compute[75071]: INFO nova.compute.manager [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:26:42 user nova-compute[75071]: INFO nova.compute.claims [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Claim successful on node user
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-2fd63437-5f62-48f2-ad9e-3b4761c0e3db req-6925026e-8db1-4c8c-bdaa-930457253304 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Received event network-vif-deleted-10d0cfed-e70a-4d6e-b80c-75e2376fc0cd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:42 user nova-compute[75071]: INFO nova.compute.manager [req-2fd63437-5f62-48f2-ad9e-3b4761c0e3db req-6925026e-8db1-4c8c-bdaa-930457253304 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Neutron deleted interface 10d0cfed-e70a-4d6e-b80c-75e2376fc0cd; detaching it from the instance and deleting it from the info cache
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-2fd63437-5f62-48f2-ad9e-3b4761c0e3db req-6925026e-8db1-4c8c-bdaa-930457253304 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:42 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 6935d835-c98f-4355-8031-4436125925f1] Took 1.18 seconds to deallocate network for instance.
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-2fd63437-5f62-48f2-ad9e-3b4761c0e3db req-6925026e-8db1-4c8c-bdaa-930457253304 service nova] [instance: 6935d835-c98f-4355-8031-4436125925f1] Detach interface failed, port_id=10d0cfed-e70a-4d6e-b80c-75e2376fc0cd, reason: Instance 6935d835-c98f-4355-8031-4436125925f1 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:26:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:26:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Creating image(s)
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "/opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "/opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "/opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG nova.policy [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '524871ebdef24e6bad499aac8cc40a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd66be1e4f2df45db96d3da55f270eff8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk 1073741824" returned: 0 in 0.050s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Successfully created port: ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Cannot resize image /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Ensure instance console log exists: /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:43 user nova-compute[75071]: INFO nova.compute.manager [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] [instance: 6935d835-c98f-4355-8031-4436125925f1] Took 1.26 seconds to detach 1 volumes for instance.
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:43 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:44 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Deleted allocations for instance 6935d835-c98f-4355-8031-4436125925f1
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Successfully updated port: ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "refresh_cache-e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquired lock "refresh_cache-e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2c41f96f-f04f-4362-9361-58d69e1ba94e tempest-ServerActionsTestOtherB-1138605091 tempest-ServerActionsTestOtherB-1138605091-project-member] Lock "6935d835-c98f-4355-8031-4436125925f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.257s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received event network-changed-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Refreshing instance network info cache due to event network-changed-ce0ce0f2-1284-4fc7-8944-d923ef911b5f. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] Acquiring lock "refresh_cache-e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Updating instance_info_cache with network_info: [{"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Releasing lock "refresh_cache-e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Instance network_info: |[{"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] Acquired lock "refresh_cache-e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Refreshing network info cache for port ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Start _get_guest_xml network_info=[{"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:26:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:26:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2068630957',display_name='tempest-DeleteServersTestJSON-server-2068630957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2068630957',id=23,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d66be1e4f2df45db96d3da55f270eff8',ramdisk_id='',reservation_id='r-yrqhsn40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1382165334',owner_user_name='tempest-DeleteServersTestJSON-1382165334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:26:43Z,user_data=None,user_id='524871ebdef24e6bad499aac8cc40a9e',uuid=e87c6f07-62b2-4fd6-a51f-4551a41b4e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Converting VIF {"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:77:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce0ce0f2-1284-4fc7-8944-d923ef911b5f,network=Network(2f075df5-29d0-49b4-9118-af95637cbd9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0ce0f2-12') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lazy-loading 'pci_devices' on Instance uuid e87c6f07-62b2-4fd6-a51f-4551a41b4e3d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:26:44 user nova-compute[75071]:   <uuid>e87c6f07-62b2-4fd6-a51f-4551a41b4e3d</uuid>
Nov 29 13:26:44 user nova-compute[75071]:   <name>instance-00000017</name>
Nov 29 13:26:44 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:26:44 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:26:44 user nova-compute[75071]:   <metadata>
Nov 29 13:26:44 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:26:44 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:26:44 user nova-compute[75071]:       <nova:name>tempest-DeleteServersTestJSON-server-2068630957</nova:name>
Nov 29 13:26:44 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:26:44</nova:creationTime>
Nov 29 13:26:44 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:26:44 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:26:44 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:26:44 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:26:44 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:26:44 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:26:44 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:26:44 user nova-compute[75071]:       <nova:owner>
Nov 29 13:26:44 user nova-compute[75071]:         <nova:user uuid="524871ebdef24e6bad499aac8cc40a9e">tempest-DeleteServersTestJSON-1382165334-project-member</nova:user>
Nov 29 13:26:44 user nova-compute[75071]:         <nova:project uuid="d66be1e4f2df45db96d3da55f270eff8">tempest-DeleteServersTestJSON-1382165334</nova:project>
Nov 29 13:26:44 user nova-compute[75071]:       </nova:owner>
Nov 29 13:26:44 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:26:44 user nova-compute[75071]:       <nova:ports>
Nov 29 13:26:44 user nova-compute[75071]:         <nova:port uuid="ce0ce0f2-1284-4fc7-8944-d923ef911b5f">
Nov 29 13:26:44 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:26:44 user nova-compute[75071]:         </nova:port>
Nov 29 13:26:44 user nova-compute[75071]:       </nova:ports>
Nov 29 13:26:44 user nova-compute[75071]:     </nova:instance>
Nov 29 13:26:44 user nova-compute[75071]:   </metadata>
Nov 29 13:26:44 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:26:44 user nova-compute[75071]:     <system>
Nov 29 13:26:44 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:26:44 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:26:44 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:26:44 user nova-compute[75071]:       <entry name="serial">e87c6f07-62b2-4fd6-a51f-4551a41b4e3d</entry>
Nov 29 13:26:44 user nova-compute[75071]:       <entry name="uuid">e87c6f07-62b2-4fd6-a51f-4551a41b4e3d</entry>
Nov 29 13:26:44 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:26:44 user nova-compute[75071]:     </system>
Nov 29 13:26:44 user nova-compute[75071]:   </sysinfo>
Nov 29 13:26:44 user nova-compute[75071]:   <os>
Nov 29 13:26:44 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:26:44 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:26:44 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:26:44 user nova-compute[75071]:   </os>
Nov 29 13:26:44 user nova-compute[75071]:   <features>
Nov 29 13:26:44 user nova-compute[75071]:     <acpi/>
Nov 29 13:26:44 user nova-compute[75071]:     <apic/>
Nov 29 13:26:44 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:26:44 user nova-compute[75071]:   </features>
Nov 29 13:26:44 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:26:44 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:26:44 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:26:44 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:26:44 user nova-compute[75071]:   </clock>
Nov 29 13:26:44 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:26:44 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:26:44 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:26:44 user nova-compute[75071]:   </cpu>
Nov 29 13:26:44 user nova-compute[75071]:   <devices>
Nov 29 13:26:44 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:26:44 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:26:44 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk"/>
Nov 29 13:26:44 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:26:44 user nova-compute[75071]:     </disk>
Nov 29 13:26:44 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:26:44 user nova-compute[75071]:       <mac address="fa:16:3e:d9:77:e8"/>
Nov 29 13:26:44 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:26:44 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:26:44 user nova-compute[75071]:       <target dev="tapce0ce0f2-12"/>
Nov 29 13:26:44 user nova-compute[75071]:     </interface>
Nov 29 13:26:44 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:26:44 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/console.log" append="off"/>
Nov 29 13:26:44 user nova-compute[75071]:     </serial>
Nov 29 13:26:44 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:26:44 user nova-compute[75071]:     <video>
Nov 29 13:26:44 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:26:44 user nova-compute[75071]:     </video>
Nov 29 13:26:44 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:26:44 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:26:44 user nova-compute[75071]:     </rng>
Nov 29 13:26:44 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:26:44 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:26:44 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:26:44 user nova-compute[75071]:     </memballoon>
Nov 29 13:26:44 user nova-compute[75071]:   </devices>
Nov 29 13:26:44 user nova-compute[75071]: </domain>
Nov 29 13:26:44 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:26:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2068630957',display_name='tempest-DeleteServersTestJSON-server-2068630957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2068630957',id=23,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d66be1e4f2df45db96d3da55f270eff8',ramdisk_id='',reservation_id='r-yrqhsn40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1382165334',owner_user_name='tempest-DeleteServersTestJSON-1382165334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:26:43Z,user_data=None,user_id='524871ebdef24e6bad499aac8cc40a9e',uuid=e87c6f07-62b2-4fd6-a51f-4551a41b4e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Converting VIF {"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:77:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce0ce0f2-1284-4fc7-8944-d923ef911b5f,network=Network(2f075df5-29d0-49b4-9118-af95637cbd9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0ce0f2-12') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG os_vif [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:77:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce0ce0f2-1284-4fc7-8944-d923ef911b5f,network=Network(2f075df5-29d0-49b4-9118-af95637cbd9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0ce0f2-12') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a49ee101-7ed4-5cd4-8b0e-04266d3c0af8', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce0ce0f2-12, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce0ce0f2-12, col_values=(('qos', UUID('d260e16e-4780-4b18-8c0c-ebba6ae823ca')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce0ce0f2-12, col_values=(('external_ids', {'iface-id': 'ce0ce0f2-1284-4fc7-8944-d923ef911b5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:77:e8', 'vm-uuid': 'e87c6f07-62b2-4fd6-a51f-4551a41b4e3d'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:44 user nova-compute[75071]: INFO os_vif [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:77:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce0ce0f2-1284-4fc7-8944-d923ef911b5f,network=Network(2f075df5-29d0-49b4-9118-af95637cbd9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0ce0f2-12')
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] No VIF found with MAC fa:16:3e:d9:77:e8, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Updated VIF entry in instance network info cache for port ce0ce0f2-1284-4fc7-8944-d923ef911b5f. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Updating instance_info_cache with network_info: [{"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66aa15e7-b057-4850-b1f5-dc443618a2fd req-840a6518-b7bc-4e5d-b0de-7ae694b56c76 service nova] Releasing lock "refresh_cache-e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:26:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:26:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac22cd34-7037-413e-ac20-18a6eb06aa75 req-b9746109-89c1-472e-bef7-bb52035e43ea service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received event network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac22cd34-7037-413e-ac20-18a6eb06aa75 req-b9746109-89c1-472e-bef7-bb52035e43ea service nova] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac22cd34-7037-413e-ac20-18a6eb06aa75 req-b9746109-89c1-472e-bef7-bb52035e43ea service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ac22cd34-7037-413e-ac20-18a6eb06aa75 req-b9746109-89c1-472e-bef7-bb52035e43ea service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-ac22cd34-7037-413e-ac20-18a6eb06aa75 req-b9746109-89c1-472e-bef7-bb52035e43ea service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] No waiting events found dispatching network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:46 user nova-compute[75071]: WARNING nova.compute.manager [req-ac22cd34-7037-413e-ac20-18a6eb06aa75 req-b9746109-89c1-472e-bef7-bb52035e43ea service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received unexpected event network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f for instance with vm_state building and task_state spawning.
Nov 29 13:26:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:26:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Instance spawned successfully.
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:48 user nova-compute[75071]: INFO nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-8ef8f00a-0f95-4c99-8f1e-cdd212273c81 req-befe4b01-3a0c-475d-b514-ae979306fb39 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received event network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8ef8f00a-0f95-4c99-8f1e-cdd212273c81 req-befe4b01-3a0c-475d-b514-ae979306fb39 service nova] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8ef8f00a-0f95-4c99-8f1e-cdd212273c81 req-befe4b01-3a0c-475d-b514-ae979306fb39 service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8ef8f00a-0f95-4c99-8f1e-cdd212273c81 req-befe4b01-3a0c-475d-b514-ae979306fb39 service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-8ef8f00a-0f95-4c99-8f1e-cdd212273c81 req-befe4b01-3a0c-475d-b514-ae979306fb39 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] No waiting events found dispatching network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:26:48 user nova-compute[75071]: WARNING nova.compute.manager [req-8ef8f00a-0f95-4c99-8f1e-cdd212273c81 req-befe4b01-3a0c-475d-b514-ae979306fb39 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received unexpected event network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f for instance with vm_state building and task_state spawning.
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:48 user nova-compute[75071]: INFO nova.compute.manager [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Took 6.55 seconds to build instance.
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9681b5bd-f360-45f2-b3b5-9667a255beaa tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.670s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:26:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.237133026123047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:26:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0c6a1702-5e65-4648-915d-2186ca6fc54c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e87c6f07-62b2-4fd6-a51f-4551a41b4e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:26:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:26:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 is timed out.
Nov 29 13:26:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully detached device vdb from instance 05b48a8b-440a-4af0-81fa-d362302c1bb8 from the live domain config.
Nov 29 13:26:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WRzJxQeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:26:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6f60a0-135c-4f5b-90bf-cebd197a8b5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:26:53 user nova-compute[75071]: No targets found.
Nov 29 13:26:53 user nova-compute[75071]: iSNS:
Nov 29 13:26:53 user nova-compute[75071]: No targets found.
Nov 29 13:26:53 user nova-compute[75071]: STATIC:
Nov 29 13:26:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:26:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:26:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:26:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef
Nov 29 13:26:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:26:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:26:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:26:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:26:53 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:26:53 user nova-compute[75071]: FIRMWARE:
Nov 29 13:26:53 user nova-compute[75071]: No targets found.
Nov 29 13:26:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:26:53 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:26:53 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd4c091-8f6a-46f0-aea3-c87199788949]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b961928-bcf2-41cf-952e-5f028c32edc2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:53 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:53 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:26:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef (non-flash)
Nov 29 13:26:53 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:26:53 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:26:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fe1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:26:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09e14fc-ab94-435f-80d3-e8a90371f3d2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917e365-87da-478e-860b-f1361cbae3bd]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30fa43f-00e3-4d81-aa26-bc6c21fff1dc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63dfc3d-ec1d-4c6b-a952-8c07c5b546a6]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1c70f6-e6ff-4d27-94d4-7515579f8658]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[270db230-7e14-48d1-bd5e-261cf6179df7]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260]
Nov 29 13:26:54 user nova-compute[75071]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef, portal: 172.16.0.220,3260] successful.
Nov 29 13:26:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ecf8b34-b51c-497c-b64a-6ad3229a18ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[632fb7d0-d392-4d5f-ba1a-e1a07c75fad8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== disconnect_volume: return (355ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updating instance_info_cache with network_info: [{"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:26:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:55 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'flavor' on Instance uuid 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:26:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5627b9c8-f1e3-4fc8-aff6-c830ba5d3c00 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:26:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:26:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:26:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing instance network info cache due to event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] Acquiring lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] Acquired lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:26:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:27:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updated VIF entry in instance network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:27:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3de51dde-26ae-41ff-9fb9-f2e09617f750 req-dd2795fd-28e3-41e4-8606-c524fb0de81a service nova] Releasing lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:03 user nova-compute[75071]: INFO nova.compute.manager [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Shelving
Nov 29 13:27:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b112263-99e1-4fde-a434-81a383721e6e req-de6bb433-9d98-42a8-9381-cb0858bac908 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-unplugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b112263-99e1-4fde-a434-81a383721e6e req-de6bb433-9d98-42a8-9381-cb0858bac908 service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b112263-99e1-4fde-a434-81a383721e6e req-de6bb433-9d98-42a8-9381-cb0858bac908 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b112263-99e1-4fde-a434-81a383721e6e req-de6bb433-9d98-42a8-9381-cb0858bac908 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b112263-99e1-4fde-a434-81a383721e6e req-de6bb433-9d98-42a8-9381-cb0858bac908 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-unplugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:04 user nova-compute[75071]: WARNING nova.compute.manager [req-2b112263-99e1-4fde-a434-81a383721e6e req-de6bb433-9d98-42a8-9381-cb0858bac908 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received unexpected event network-vif-unplugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with vm_state active and task_state shelving.
Nov 29 13:27:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance destroyed successfully.
Nov 29 13:27:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Beginning cold snapshot process
Nov 29 13:27:04 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk /opt/stack/data/nova/instances/snapshots/tmpazz6wxq1/cac0e08d043e4cf38cdbdcaea2984a3c {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:27:05 user nova-compute[75071]: INFO nova.compute.claims [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Claim successful on node user
Nov 29 13:27:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk /opt/stack/data/nova/instances/snapshots/tmpazz6wxq1/cac0e08d043e4cf38cdbdcaea2984a3c" returned: 0 in 0.960s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Snapshot extracted, beginning image upload
Nov 29 13:27:05 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:27:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:27:06 user nova-compute[75071]: INFO nova.virt.block_device [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Booting with volume 45b95d97-ae9c-4e05-8ec4-7856a367f9b1 at /dev/vda
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.policy [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6af3003b85a4cc281a9d2bbb9465fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5dedba01ce4e37a5b067def2eaea80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-d134ba9b-103c-41f4-a17b-9b967a4bc3ec req-3e54dac7-334e-48e6-aa1d-69a8a428c960 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d134ba9b-103c-41f4-a17b-9b967a4bc3ec req-3e54dac7-334e-48e6-aa1d-69a8a428c960 service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d134ba9b-103c-41f4-a17b-9b967a4bc3ec req-3e54dac7-334e-48e6-aa1d-69a8a428c960 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d134ba9b-103c-41f4-a17b-9b967a4bc3ec req-3e54dac7-334e-48e6-aa1d-69a8a428c960 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-d134ba9b-103c-41f4-a17b-9b967a4bc3ec req-3e54dac7-334e-48e6-aa1d-69a8a428c960 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:06 user nova-compute[75071]: WARNING nova.compute.manager [req-d134ba9b-103c-41f4-a17b-9b967a4bc3ec req-3e54dac7-334e-48e6-aa1d-69a8a428c960 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received unexpected event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 13:27:06 user nova-compute[75071]: DEBUG os_brick.utils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb521b7d-1316-44e8-9d3d-527070123b6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef1c9e-8146-4c57-9610-3d20ce1f62fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea580e3-c2eb-46c1-83c6-df3b7a05e5b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ffdc3f-7071-4d94-a0fe-901c6138cac5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:27:06 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:27:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5927f0c-8d0a-41d7-98a0-2f80b1e6d26d]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG os_brick.utils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updating existing volume attachment record: 355d4759-4ec6-4977-85b6-197f9332cd74 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Successfully created port: 3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Successfully updated port: 3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquired lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-changed-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Refreshing instance network info cache due to event network-changed-3b3aaef8-787e-4dcb-aa02-987d3920cb65. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] Acquiring lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updating instance_info_cache with network_info: [{"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Releasing lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance network_info: |[{"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] Acquired lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Refreshing network info cache for port 3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updated VIF entry in instance network info cache for port 3b3aaef8-787e-4dcb-aa02-987d3920cb65. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updating instance_info_cache with network_info: [{"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6433dc7f-0525-4041-867c-b24078a40436 req-8aa035ce-4dd5-465b-9fac-b7dce045f122 service nova] Releasing lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Snapshot image upload complete
Nov 29 13:27:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:08 user nova-compute[75071]: INFO nova.compute.manager [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Shelve offloading
Nov 29 13:27:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance destroyed successfully.
Nov 29 13:27:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquired lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Releasing lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance destroyed successfully.
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'resources' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1897835708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1897835708',id=20,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXsJ5XQa2UWegE5sMjsQzlXf2iXtgaMgOt29b5FNqf5KhFVTOCjbdjPWgrKECK3+uPt8/RcqdROcEYKm0ZLCBWwPc3xPwy8nYxmWLtQaXOoiEiqMokCgoy016PpX/yRuA==',key_name='tempest-keypair-973435994',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-3z5pz8a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member',shelved_at='2023-11-29T13:27:08.353453',shelved_host='user',shelved_image_id='ec3e2055-27a0-4d2f-bf46-c5f170a4510a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=73c90d9c-3089-4d7b-9ac9-7c2105cd4649,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG os_vif [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b97467c-89, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c5bfcb7-5f75-46c4-b7fa-6817c4e2caea) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:09 user nova-compute[75071]: INFO os_vif [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89')
Nov 29 13:27:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Deleting instance files /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649_del
Nov 29 13:27:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Deletion of /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649_del complete
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing instance network info cache due to event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] Acquiring lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] Acquired lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:27:09 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Deleted allocations for instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649
Nov 29 13:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'numa_topology' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.objects.base [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<73c90d9c-3089-4d7b-9ac9-7c2105cd4649> lazy-loaded attributes: resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:27:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:27:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updated VIF entry in instance network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:27:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8b97467c-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0ff3e6de-1e31-4f42-b3ac-6ff981770aef req-7be955a5-108b-4d47-be90-c8e78ad75786 service nova] Releasing lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6d208568-40a1-4cea-b9c8-68b69f9d6c36 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.481s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:27:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Creating image(s)
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Ensure instance console log exists: /opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Start _get_guest_xml network_info=[{"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '003e4c80-34c6-4c05-a9a7-9da023b7bc0e', 'attached_at': '', 'detached_at': '', 'volume_id': '45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'serial': '45b95d97-ae9c-4e05-8ec4-7856a367f9b1'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '355d4759-4ec6-4977-85b6-197f9332cd74', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:27:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:27:14 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:27:14 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:27:14 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e776e23b-bb45-4a41-b7e3-b70228e6d536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:27:14 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c6877-f6d2-4f0d-92ca-8dfa3a6f1e8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1] added
Nov 29 13:27:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f9aa0b-265c-44c8-a916-8e0114546852]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64f19dc-9dbe-4249-8596-51192a206d37]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIlVgBcU {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIlVgBcU" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feac75e-d852-4fd8-b4b3-805efe955ddc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIlVgBcU'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a05a494-6d9e-4a33-84e7-9da4e7f7f133]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e095067-9929-4399-b15d-90ef29e6e216]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30929a25-cf81-4501-aaf9-1f8085899b5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]
Nov 29 13:27:14 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.
Nov 29 13:27:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e90a6d-7a89-44c4-8ae0-a749f4ad7b1b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c83c38-50cb-43b2-ab7b-1bc4ce72919c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:27:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a93ef7-923c-4908-9f5e-89a2c3804dc7]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:27:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26138396437643130', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138396437643130', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2077791717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2077791717',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfBnNA+l6YYtmYNkSg1+7s0Ze1ddryiQfXZLhNcjqMSj8oc5W03kR1glk/dkK9+JrmXvGkDbgD54809kDz8qwdonFyg6AQ17M2qJSInHDXXwV1R8WVChhaoXbQGyjkmag==',key_name='tempest-keypair-1963758755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5dedba01ce4e37a5b067def2eaea80',ramdisk_id='',reservation_id='r-25i14ftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1240456810',owner_user_name='tempest-ServerActionsV293TestJSON-1240456810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6af3003b85a4cc281a9d2bbb9465fdb',uuid=003e4c80-34c6-4c05-a9a7-9da023b7bc0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converting VIF {"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lazy-loading 'pci_devices' on Instance uuid 003e4c80-34c6-4c05-a9a7-9da023b7bc0e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:27:15 user nova-compute[75071]:   <uuid>003e4c80-34c6-4c05-a9a7-9da023b7bc0e</uuid>
Nov 29 13:27:15 user nova-compute[75071]:   <name>instance-00000018</name>
Nov 29 13:27:15 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:27:15 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:27:15 user nova-compute[75071]:   <metadata>
Nov 29 13:27:15 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:27:15 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:27:15 user nova-compute[75071]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2077791717</nova:name>
Nov 29 13:27:15 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:27:14</nova:creationTime>
Nov 29 13:27:15 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:27:15 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:27:15 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:27:15 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:27:15 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:27:15 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:27:15 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:27:15 user nova-compute[75071]:       <nova:owner>
Nov 29 13:27:15 user nova-compute[75071]:         <nova:user uuid="e6af3003b85a4cc281a9d2bbb9465fdb">tempest-ServerActionsV293TestJSON-1240456810-project-member</nova:user>
Nov 29 13:27:15 user nova-compute[75071]:         <nova:project uuid="8a5dedba01ce4e37a5b067def2eaea80">tempest-ServerActionsV293TestJSON-1240456810</nova:project>
Nov 29 13:27:15 user nova-compute[75071]:       </nova:owner>
Nov 29 13:27:15 user nova-compute[75071]:       <nova:ports>
Nov 29 13:27:15 user nova-compute[75071]:         <nova:port uuid="3b3aaef8-787e-4dcb-aa02-987d3920cb65">
Nov 29 13:27:15 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:27:15 user nova-compute[75071]:         </nova:port>
Nov 29 13:27:15 user nova-compute[75071]:       </nova:ports>
Nov 29 13:27:15 user nova-compute[75071]:     </nova:instance>
Nov 29 13:27:15 user nova-compute[75071]:   </metadata>
Nov 29 13:27:15 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:27:15 user nova-compute[75071]:     <system>
Nov 29 13:27:15 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:27:15 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:27:15 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:27:15 user nova-compute[75071]:       <entry name="serial">003e4c80-34c6-4c05-a9a7-9da023b7bc0e</entry>
Nov 29 13:27:15 user nova-compute[75071]:       <entry name="uuid">003e4c80-34c6-4c05-a9a7-9da023b7bc0e</entry>
Nov 29 13:27:15 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:27:15 user nova-compute[75071]:     </system>
Nov 29 13:27:15 user nova-compute[75071]:   </sysinfo>
Nov 29 13:27:15 user nova-compute[75071]:   <os>
Nov 29 13:27:15 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:27:15 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:27:15 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:27:15 user nova-compute[75071]:   </os>
Nov 29 13:27:15 user nova-compute[75071]:   <features>
Nov 29 13:27:15 user nova-compute[75071]:     <acpi/>
Nov 29 13:27:15 user nova-compute[75071]:     <apic/>
Nov 29 13:27:15 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:27:15 user nova-compute[75071]:   </features>
Nov 29 13:27:15 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:27:15 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:27:15 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:27:15 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:27:15 user nova-compute[75071]:   </clock>
Nov 29 13:27:15 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:27:15 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:27:15 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:27:15 user nova-compute[75071]:   </cpu>
Nov 29 13:27:15 user nova-compute[75071]:   <devices>
Nov 29 13:27:15 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:27:15 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:27:15 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Nov 29 13:27:15 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:27:15 user nova-compute[75071]:       <serial>45b95d97-ae9c-4e05-8ec4-7856a367f9b1</serial>
Nov 29 13:27:15 user nova-compute[75071]:     </disk>
Nov 29 13:27:15 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:27:15 user nova-compute[75071]:       <mac address="fa:16:3e:6d:32:0d"/>
Nov 29 13:27:15 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:27:15 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:27:15 user nova-compute[75071]:       <target dev="tap3b3aaef8-78"/>
Nov 29 13:27:15 user nova-compute[75071]:     </interface>
Nov 29 13:27:15 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:27:15 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e/console.log" append="off"/>
Nov 29 13:27:15 user nova-compute[75071]:     </serial>
Nov 29 13:27:15 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:27:15 user nova-compute[75071]:     <video>
Nov 29 13:27:15 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:27:15 user nova-compute[75071]:     </video>
Nov 29 13:27:15 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:27:15 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:27:15 user nova-compute[75071]:     </rng>
Nov 29 13:27:15 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:27:15 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:27:15 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:27:15 user nova-compute[75071]:     </memballoon>
Nov 29 13:27:15 user nova-compute[75071]:   </devices>
Nov 29 13:27:15 user nova-compute[75071]: </domain>
Nov 29 13:27:15 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2077791717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2077791717',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfBnNA+l6YYtmYNkSg1+7s0Ze1ddryiQfXZLhNcjqMSj8oc5W03kR1glk/dkK9+JrmXvGkDbgD54809kDz8qwdonFyg6AQ17M2qJSInHDXXwV1R8WVChhaoXbQGyjkmag==',key_name='tempest-keypair-1963758755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a5dedba01ce4e37a5b067def2eaea80',ramdisk_id='',reservation_id='r-25i14ftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1240456810',owner_user_name='tempest-ServerActionsV293TestJSON-1240456810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:27:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6af3003b85a4cc281a9d2bbb9465fdb',uuid=003e4c80-34c6-4c05-a9a7-9da023b7bc0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converting VIF {"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG os_vif [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '146fcc45-1791-5968-a398-210ea77999c1', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b3aaef8-78, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b3aaef8-78, col_values=(('qos', UUID('dfd7f778-1de4-49e2-ae18-14fbe61d4657')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b3aaef8-78, col_values=(('external_ids', {'iface-id': '3b3aaef8-787e-4dcb-aa02-987d3920cb65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:32:0d', 'vm-uuid': '003e4c80-34c6-4c05-a9a7-9da023b7bc0e'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:15 user nova-compute[75071]: INFO os_vif [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78')
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:27:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] No VIF found with MAC fa:16:3e:6d:32:0d, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:27:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-04ef70c8-0317-47c0-8dd5-ed049e745efc req-4ce1546f-251e-4a56-a219-ebcb83cd2938 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-04ef70c8-0317-47c0-8dd5-ed049e745efc req-4ce1546f-251e-4a56-a219-ebcb83cd2938 service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-04ef70c8-0317-47c0-8dd5-ed049e745efc req-4ce1546f-251e-4a56-a219-ebcb83cd2938 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-04ef70c8-0317-47c0-8dd5-ed049e745efc req-4ce1546f-251e-4a56-a219-ebcb83cd2938 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-04ef70c8-0317-47c0-8dd5-ed049e745efc req-4ce1546f-251e-4a56-a219-ebcb83cd2938 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:17 user nova-compute[75071]: WARNING nova.compute.manager [req-04ef70c8-0317-47c0-8dd5-ed049e745efc req-4ce1546f-251e-4a56-a219-ebcb83cd2938 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received unexpected event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with vm_state building and task_state spawning.
Nov 29 13:27:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-3220fe26-947f-4a39-bf68-454d0c4a1ddc req-4055c029-a91b-4fbb-b075-48a6a2f8189c service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3220fe26-947f-4a39-bf68-454d0c4a1ddc req-4055c029-a91b-4fbb-b075-48a6a2f8189c service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3220fe26-947f-4a39-bf68-454d0c4a1ddc req-4055c029-a91b-4fbb-b075-48a6a2f8189c service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3220fe26-947f-4a39-bf68-454d0c4a1ddc req-4055c029-a91b-4fbb-b075-48a6a2f8189c service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-3220fe26-947f-4a39-bf68-454d0c4a1ddc req-4055c029-a91b-4fbb-b075-48a6a2f8189c service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:19 user nova-compute[75071]: WARNING nova.compute.manager [req-3220fe26-947f-4a39-bf68-454d0c4a1ddc req-4055c029-a91b-4fbb-b075-48a6a2f8189c service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received unexpected event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with vm_state building and task_state spawning.
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:27:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance spawned successfully.
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:27:19 user nova-compute[75071]: INFO nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 29 13:27:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:27:19 user nova-compute[75071]: INFO nova.compute.manager [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Took 14.08 seconds to build instance.
Nov 29 13:27:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4c6cc599-5688-461f-9468-5e0492061892 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.244s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:22 user nova-compute[75071]: INFO nova.compute.manager [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Detaching volume ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:27:22 user nova-compute[75071]: INFO nova.virt.block_device [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Attempting to driver detach volume ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 from mountpoint /dev/vdb
Nov 29 13:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Attempting to detach device vdb from instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:27:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:27:22 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:27:22 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:27:22 user nova-compute[75071]:   <serial>ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984</serial>
Nov 29 13:27:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:27:22 user nova-compute[75071]: </disk>
Nov 29 13:27:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:27:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully detached device vdb from instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 from the persistent domain config.
Nov 29 13:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:27:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:27:22 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:27:22 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:27:22 user nova-compute[75071]:   <serial>ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984</serial>
Nov 29 13:27:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:27:22 user nova-compute[75071]: </disk>
Nov 29 13:27:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:23 user nova-compute[75071]: INFO nova.compute.manager [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Terminating instance
Nov 29 13:27:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3c00affa-9265-4785-8280-1205b6144af4 req-e3c90604-091f-4d65-88c5-0447d057e5f7 service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-unplugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3c00affa-9265-4785-8280-1205b6144af4 req-e3c90604-091f-4d65-88c5-0447d057e5f7 service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3c00affa-9265-4785-8280-1205b6144af4 req-e3c90604-091f-4d65-88c5-0447d057e5f7 service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3c00affa-9265-4785-8280-1205b6144af4 req-e3c90604-091f-4d65-88c5-0447d057e5f7 service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3c00affa-9265-4785-8280-1205b6144af4 req-e3c90604-091f-4d65-88c5-0447d057e5f7 service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-unplugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3c00affa-9265-4785-8280-1205b6144af4 req-e3c90604-091f-4d65-88c5-0447d057e5f7 service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-unplugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Instance destroyed successfully.
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'resources' on Instance uuid 05b48a8b-440a-4af0-81fa-d362302c1bb8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:21:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1695895604',display_name='tempest-ServerActionsTestOtherA-server-625614162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1695895604',id=14,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/BEBsu8SWQyVo+EcpBRy6SlkamoX5CmQ7XusjEdiTF0jfoalIP8ATzoKuWNZR7C/WHWOVQ9RJolPyVo3wBS3c6D10E/7lFvIfa8WcYKX9M3zt4uF7yzhKQCoeIPMhBnw==',key_name='tempest-keypair-1558894449',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dp042j4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=05b48a8b-440a-4af0-81fa-d362302c1bb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "address": "fa:16:3e:1f:41:4b", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ce1c68-dc", "ovs_interfaceid": "b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG os_vif [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3ce1c68-dc, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9ef7eef-bc49-4e7f-8a1e-b08ccd789be4) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:27:24 user nova-compute[75071]: INFO os_vif [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:41:4b,bridge_name='br-int',has_traffic_filtering=True,id=b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ce1c68-dc')
Nov 29 13:27:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Deleting instance files /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8_del
Nov 29 13:27:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Deletion of /opt/stack/data/nova/instances/05b48a8b-440a-4af0-81fa-d362302c1bb8_del complete
Nov 29 13:27:24 user nova-compute[75071]: INFO nova.compute.manager [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 13:27:24 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:27:24 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:27:25 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:25 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Took 0.69 seconds to deallocate network for instance.
Nov 29 13:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:25 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:27:25 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:25 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Deleted allocations for instance 05b48a8b-440a-4af0-81fa-d362302c1bb8
Nov 29 13:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6e485e1-ce56-4a23-bb11-88e254442096 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.058s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-85f71ef2-910c-44b2-bdd5-54aefef57fd3 req-1dc5e4d1-ec6b-4728-bc15-8b060a684b0b service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85f71ef2-910c-44b2-bdd5-54aefef57fd3 req-1dc5e4d1-ec6b-4728-bc15-8b060a684b0b service nova] Acquiring lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85f71ef2-910c-44b2-bdd5-54aefef57fd3 req-1dc5e4d1-ec6b-4728-bc15-8b060a684b0b service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85f71ef2-910c-44b2-bdd5-54aefef57fd3 req-1dc5e4d1-ec6b-4728-bc15-8b060a684b0b service nova] Lock "05b48a8b-440a-4af0-81fa-d362302c1bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-85f71ef2-910c-44b2-bdd5-54aefef57fd3 req-1dc5e4d1-ec6b-4728-bc15-8b060a684b0b service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] No waiting events found dispatching network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:26 user nova-compute[75071]: WARNING nova.compute.manager [req-85f71ef2-910c-44b2-bdd5-54aefef57fd3 req-1dc5e4d1-ec6b-4728-bc15-8b060a684b0b service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received unexpected event network-vif-plugged-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 for instance with vm_state deleted and task_state None.
Nov 29 13:27:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-85f71ef2-910c-44b2-bdd5-54aefef57fd3 req-1dc5e4d1-ec6b-4728-bc15-8b060a684b0b service nova] [instance: 05b48a8b-440a-4af0-81fa-d362302c1bb8] Received event network-vif-deleted-b3ce1c68-dc58-4ffe-b6e5-26a2406dbc14 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:27:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 is timed out.
Nov 29 13:27:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully detached device vdb from instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 from the live domain config.
Nov 29 13:27:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFnfrzot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:27:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb3d57c-75ea-4a96-9da9-d142ebbafa13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:27:43 user nova-compute[75071]: No targets found.
Nov 29 13:27:43 user nova-compute[75071]: iSNS:
Nov 29 13:27:43 user nova-compute[75071]: No targets found.
Nov 29 13:27:43 user nova-compute[75071]: STATIC:
Nov 29 13:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984
Nov 29 13:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:27:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1
Nov 29 13:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:27:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:27:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:27:43 user nova-compute[75071]: FIRMWARE:
Nov 29 13:27:43 user nova-compute[75071]: No targets found.
Nov 29 13:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:27:43 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:27:43 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[743eeaa5-c869-45d0-9ca8-010690c10445]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a827f18-6f2b-41a5-b1fe-8129e6552850]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:27:43 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 (non-flash)
Nov 29 13:27:43 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124facdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc1cfa9-77fa-49c4-8806-be26a26146bb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0edc0b-99e6-4cb7-9174-d54b79b74f66]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4e3c10-cc49-406f-968e-9b60ac6e69ac]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f638ae-edaf-4777-98c4-2fe8289e7dd1]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a52a8b-5fea-4ed8-95fd-d35e2475446a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3d8558-053a-445c-8157-78912643320d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260]
Nov 29 13:27:43 user nova-compute[75071]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984, portal: 172.16.0.220,3260] successful.
Nov 29 13:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8c53e0-fa2a-44ce-a3e3-5bcd0123f984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e23c6c-f47e-4f9b-8aef-29d85d698826]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== disconnect_volume: return (320ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:27:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:27:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d7da15e2-3b7d-4f36-9ca3-55f3aae38789 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:45 user nova-compute[75071]: INFO nova.compute.manager [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Rescuing
Nov 29 13:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:27:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating instance_info_cache with network_info: [{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-2caebeae-1251-477a-aaaa-14eb708399db req-a6471807-153c-47fc-96ea-f725fc0cf0eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2caebeae-1251-477a-aaaa-14eb708399db req-a6471807-153c-47fc-96ea-f725fc0cf0eb service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2caebeae-1251-477a-aaaa-14eb708399db req-a6471807-153c-47fc-96ea-f725fc0cf0eb service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2caebeae-1251-477a-aaaa-14eb708399db req-a6471807-153c-47fc-96ea-f725fc0cf0eb service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-2caebeae-1251-477a-aaaa-14eb708399db req-a6471807-153c-47fc-96ea-f725fc0cf0eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:46 user nova-compute[75071]: WARNING nova.compute.manager [req-2caebeae-1251-477a-aaaa-14eb708399db req-a6471807-153c-47fc-96ea-f725fc0cf0eb service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state active and task_state rescuing.
Nov 29 13:27:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance destroyed successfully.
Nov 29 13:27:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Attempting a stable device rescue
Nov 29 13:27:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:27:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Creating image(s)
Nov 29 13:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "/opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "fd7a9b8b54cf9a500065bbf0c942db62808c6e86" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fd7a9b8b54cf9a500065bbf0c942db62808c6e86" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.part --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG nova.virt.images [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] 54a0c9e6-1952-47b5-a0b1-9a885e6bd64e was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.part /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-5591dd48-28a4-4a49-9330-0e324c347ab5 req-0b5bf2ce-07a5-4ea9-a9f4-f0d4cd7f24ae service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5591dd48-28a4-4a49-9330-0e324c347ab5 req-0b5bf2ce-07a5-4ea9-a9f4-f0d4cd7f24ae service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5591dd48-28a4-4a49-9330-0e324c347ab5 req-0b5bf2ce-07a5-4ea9-a9f4-f0d4cd7f24ae service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5591dd48-28a4-4a49-9330-0e324c347ab5 req-0b5bf2ce-07a5-4ea9-a9f4-f0d4cd7f24ae service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-5591dd48-28a4-4a49-9330-0e324c347ab5 req-0b5bf2ce-07a5-4ea9-a9f4-f0d4cd7f24ae service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:48 user nova-compute[75071]: WARNING nova.compute.manager [req-5591dd48-28a4-4a49-9330-0e324c347ab5 req-0b5bf2ce-07a5-4ea9-a9f4-f0d4cd7f24ae service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state active and task_state rescuing.
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.part /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.converted" returned: 0 in 0.266s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fd7a9b8b54cf9a500065bbf0c942db62808c6e86" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.829s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "fd7a9b8b54cf9a500065bbf0c942db62808c6e86" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fd7a9b8b54cf9a500065bbf0c942db62808c6e86" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86 --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86,backing_fmt=raw /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86,backing_fmt=raw /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue" returned: 0 in 0.062s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fd7a9b8b54cf9a500065bbf0c942db62808c6e86" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'migration_context' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Start _get_guest_xml network_info=[{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "vif_mac": "fa:16:3e:bb:24:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '54a0c9e6-1952-47b5-a0b1-9a885e6bd64e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcqzUwCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d', 'attached_at': '', 'detached_at': '', 'volume_id': '8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'serial': '8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '52aa2196-8f57-482d-a021-ba3bf22a91c0', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'resources' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'numa_topology' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcqzUwCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:27:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:27:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:27:49 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8203a-a5fe-4563-a9db-8ab253101c21]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZcqzUwCe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 13:27:49 user nova-compute[75071]: node.name = iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:27:49 user nova-compute[75071]: node.tpgt = -1
Nov 29 13:27:49 user nova-compute[75071]: node.startup = automatic
Nov 29 13:27:49 user nova-compute[75071]: node.leading_login = No
Nov 29 13:27:49 user nova-compute[75071]: iface.iscsi_ifacename = default
Nov 29 13:27:49 user nova-compute[75071]: iface.net_ifacename = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.ipaddress = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.prefix_len = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.hwaddress = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.transport_name = tcp
Nov 29 13:27:49 user nova-compute[75071]: iface.initiatorname = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.state = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.vlan_id = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.vlan_priority = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.vlan_state = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.iface_num = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.mtu = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.port = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.bootproto = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.subnet_mask = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.gateway = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_alt_client_id = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_dns = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_learn_iqn = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_vendor_id_state = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_vendor_id = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.dhcp_slp_da = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.fragmentation = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.gratuitous_arp = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.incoming_forwarding = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.tos_state = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.tos = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.ttl = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.delayed_ack = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.tcp_nagle = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.tcp_wsf_state = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.tcp_wsf = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.tcp_timer_scale = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.tcp_timestamp = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.redirect = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.def_task_mgmt_timeout = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.header_digest = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.data_digest = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.immediate_data = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.initial_r2t = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.data_seq_inorder = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.data_pdu_inorder = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.erl = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.max_receive_data_len = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.first_burst_len = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.max_outstanding_r2t = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.max_burst_len = 0
Nov 29 13:27:49 user nova-compute[75071]: iface.chap_auth = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.bidi_chap = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.strict_login_compliance = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.discovery_auth = <empty>
Nov 29 13:27:49 user nova-compute[75071]: iface.discovery_logout = <empty>
Nov 29 13:27:49 user nova-compute[75071]: node.discovery_address = <empty>
Nov 29 13:27:49 user nova-compute[75071]: node.discovery_port = 0
Nov 29 13:27:49 user nova-compute[75071]: node.discovery_type = static
Nov 29 13:27:49 user nova-compute[75071]: node.session.initial_cmdsn = 0
Nov 29 13:27:49 user nova-compute[75071]: node.session.initial_login_retry_max = 8
Nov 29 13:27:49 user nova-compute[75071]: node.session.xmit_thread_priority = -20
Nov 29 13:27:49 user nova-compute[75071]: node.session.cmds_max = 128
Nov 29 13:27:49 user nova-compute[75071]: node.session.queue_depth = 32
Nov 29 13:27:49 user nova-compute[75071]: node.session.nr_sessions = 1
Nov 29 13:27:49 user nova-compute[75071]: node.session.auth.authmethod = CHAP
Nov 29 13:27:49 user nova-compute[75071]: node.session.auth.username = ZcqzUwCe
Nov 29 13:27:49 user nova-compute[75071]: node.session.auth.password = ***
Nov 29 13:27:49 user nova-compute[75071]: node.session.auth.username_in = <empty>
Nov 29 13:27:49 user nova-compute[75071]: node.session.auth.password_in = <empty>
Nov 29 13:27:49 user nova-compute[75071]: node.session.auth.chap_algs = MD5
Nov 29 13:27:49 user nova-compute[75071]: node.session.timeo.replacement_timeout = 120
Nov 29 13:27:49 user nova-compute[75071]: node.session.err_timeo.abort_timeout = 15
Nov 29 13:27:49 user nova-compute[75071]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 13:27:49 user nova-compute[75071]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 13:27:49 user nova-compute[75071]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.FastAbort = Yes
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.InitialR2T = No
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.ImmediateData = Yes
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.MaxConnections = 1
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 13:27:49 user nova-compute[75071]: node.session.iscsi.ERL = 0
Nov 29 13:27:49 user nova-compute[75071]: node.session.scan = manual
Nov 29 13:27:49 user nova-compute[75071]: node.session.reopen_max = 0
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].address = 172.16.0.220
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].port = 3260
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].startup = manual
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].tcp.window_size = 524288
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].tcp.type_of_service = 0
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].timeo.logout_timeout = 15
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].timeo.login_timeout = 15
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].timeo.auth_timeout = 45
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].iscsi.DataDigest = None
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].iscsi.IFMarker = No
Nov 29 13:27:49 user nova-compute[75071]: node.conn[0].iscsi.OFMarker = No
Nov 29 13:27:49 user nova-compute[75071]: # END RECORD
Nov 29 13:27:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1004e146-56c9-4559-b2de-d7228b0adf99]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[740a7ad3-aee0-4638-91db-3cdb1f9be8b2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcqzUwCe {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcqzUwCe" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f410b8a-a5e6-4d05-84fe-43b8fb3f3748]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcqzUwCe'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb7fb7a-1c8f-4764-b120-93aba98a3ae8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b44c7-9e2a-49e4-9826-19e5c1cde5f4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:49 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:27:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:27:49 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:27:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.210s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] HCTL ('35', '0', '0', 0) found on session 26 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21308a4-fd79-45f3-9386-2b0bbd72c972]: (4, ('0 0 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching for a device in session 26 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcqzUwCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.246s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== connect_volume: return (248ms) {'type': 'block', 'scsi_wwn': '23564336538626537', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564336538626537', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-693445275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-693445275',id=21,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-3r3k8o12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:26:14Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "vif_mac": "fa:16:3e:bb:24:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "vif_mac": "fa:16:3e:bb:24:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'pci_devices' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.objects.base [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:27:49 user nova-compute[75071]:   <uuid>7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d</uuid>
Nov 29 13:27:49 user nova-compute[75071]:   <name>instance-00000015</name>
Nov 29 13:27:49 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:27:49 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:27:49 user nova-compute[75071]:   <metadata>
Nov 29 13:27:49 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:27:49 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:27:49 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-693445275</nova:name>
Nov 29 13:27:49 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:27:49</nova:creationTime>
Nov 29 13:27:49 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:27:49 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:27:49 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:27:49 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:27:49 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:27:49 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:27:49 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:27:49 user nova-compute[75071]:       <nova:owner>
Nov 29 13:27:49 user nova-compute[75071]:         <nova:user uuid="f902428dcca045ffa81dbd8fd53048b6">tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member</nova:user>
Nov 29 13:27:49 user nova-compute[75071]:         <nova:project uuid="ecd1e8292884439b8d49dd698bf812e1">tempest-ServerBootFromVolumeStableRescueTest-398011867</nova:project>
Nov 29 13:27:49 user nova-compute[75071]:       </nova:owner>
Nov 29 13:27:49 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:27:49 user nova-compute[75071]:       <nova:ports>
Nov 29 13:27:49 user nova-compute[75071]:         <nova:port uuid="45921a18-24fc-47db-a80d-93de497a66e8">
Nov 29 13:27:49 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:27:49 user nova-compute[75071]:         </nova:port>
Nov 29 13:27:49 user nova-compute[75071]:       </nova:ports>
Nov 29 13:27:49 user nova-compute[75071]:     </nova:instance>
Nov 29 13:27:49 user nova-compute[75071]:   </metadata>
Nov 29 13:27:49 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:27:49 user nova-compute[75071]:     <system>
Nov 29 13:27:49 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:27:49 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:27:49 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:27:49 user nova-compute[75071]:       <entry name="serial">7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d</entry>
Nov 29 13:27:49 user nova-compute[75071]:       <entry name="uuid">7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d</entry>
Nov 29 13:27:49 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:27:49 user nova-compute[75071]:     </system>
Nov 29 13:27:49 user nova-compute[75071]:   </sysinfo>
Nov 29 13:27:49 user nova-compute[75071]:   <os>
Nov 29 13:27:49 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:27:49 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:27:49 user nova-compute[75071]:   </os>
Nov 29 13:27:49 user nova-compute[75071]:   <features>
Nov 29 13:27:49 user nova-compute[75071]:     <acpi/>
Nov 29 13:27:49 user nova-compute[75071]:     <apic/>
Nov 29 13:27:49 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:27:49 user nova-compute[75071]:   </features>
Nov 29 13:27:49 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:27:49 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:27:49 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:27:49 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:27:49 user nova-compute[75071]:   </clock>
Nov 29 13:27:49 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:27:49 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:27:49 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:27:49 user nova-compute[75071]:   </cpu>
Nov 29 13:27:49 user nova-compute[75071]:   <devices>
Nov 29 13:27:49 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:27:49 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:27:49 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Nov 29 13:27:49 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:27:49 user nova-compute[75071]:       <serial>8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36</serial>
Nov 29 13:27:49 user nova-compute[75071]:     </disk>
Nov 29 13:27:49 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:27:49 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:27:49 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue"/>
Nov 29 13:27:49 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:27:49 user nova-compute[75071]:       <boot order="1"/>
Nov 29 13:27:49 user nova-compute[75071]:     </disk>
Nov 29 13:27:49 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:27:49 user nova-compute[75071]:       <mac address="fa:16:3e:bb:24:2b"/>
Nov 29 13:27:49 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:27:49 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:27:49 user nova-compute[75071]:       <target dev="tap45921a18-24"/>
Nov 29 13:27:49 user nova-compute[75071]:     </interface>
Nov 29 13:27:49 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:27:49 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/console.log" append="off"/>
Nov 29 13:27:49 user nova-compute[75071]:     </serial>
Nov 29 13:27:49 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:27:49 user nova-compute[75071]:     <video>
Nov 29 13:27:49 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:27:49 user nova-compute[75071]:     </video>
Nov 29 13:27:49 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:27:49 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:27:49 user nova-compute[75071]:     </rng>
Nov 29 13:27:49 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:27:49 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:27:49 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:27:49 user nova-compute[75071]:     </memballoon>
Nov 29 13:27:49 user nova-compute[75071]:   </devices>
Nov 29 13:27:49 user nova-compute[75071]: </domain>
Nov 29 13:27:49 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:27:49 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance destroyed successfully.
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No VIF found with MAC fa:16:3e:bb:24:2b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:27:51 user nova-compute[75071]: INFO nova.compute.claims [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Claim successful on node user
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-aaeffec6-b84d-4ee6-8b07-10bf0615b0cb req-20c2068b-5b9c-4be4-8a0a-9450e58c97d8 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aaeffec6-b84d-4ee6-8b07-10bf0615b0cb req-20c2068b-5b9c-4be4-8a0a-9450e58c97d8 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aaeffec6-b84d-4ee6-8b07-10bf0615b0cb req-20c2068b-5b9c-4be4-8a0a-9450e58c97d8 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aaeffec6-b84d-4ee6-8b07-10bf0615b0cb req-20c2068b-5b9c-4be4-8a0a-9450e58c97d8 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-aaeffec6-b84d-4ee6-8b07-10bf0615b0cb req-20c2068b-5b9c-4be4-8a0a-9450e58c97d8 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:51 user nova-compute[75071]: WARNING nova.compute.manager [req-aaeffec6-b84d-4ee6-8b07-10bf0615b0cb req-20c2068b-5b9c-4be4-8a0a-9450e58c97d8 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state active and task_state rescuing.
Nov 29 13:27:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:27:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:27:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:27:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:27:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.policy [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80b78150bab7440daf6d7fe0d25d4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fead1ec3dc0456eb2dd2290009247a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-14de4777-08b6-4418-9019-a08b0780d161 req-ccb4ef3b-7b79-4030-9238-c4e57499c895 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14de4777-08b6-4418-9019-a08b0780d161 req-ccb4ef3b-7b79-4030-9238-c4e57499c895 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14de4777-08b6-4418-9019-a08b0780d161 req-ccb4ef3b-7b79-4030-9238-c4e57499c895 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14de4777-08b6-4418-9019-a08b0780d161 req-ccb4ef3b-7b79-4030-9238-c4e57499c895 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-14de4777-08b6-4418-9019-a08b0780d161 req-ccb4ef3b-7b79-4030-9238-c4e57499c895 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:53 user nova-compute[75071]: WARNING nova.compute.manager [req-14de4777-08b6-4418-9019-a08b0780d161 req-ccb4ef3b-7b79-4030-9238-c4e57499c895 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state active and task_state rescuing.
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e2b9d331-9254-4613-a3d4-d5489ff00909 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7987MB free_disk=25.19367218017578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'flavor' on Instance uuid 0c6a1702-5e65-4648-915d-2186ca6fc54c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:27:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Creating image(s)
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0c6a1702-5e65-4648-915d-2186ca6fc54c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e87c6f07-62b2-4fd6-a51f-4551a41b4e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 003e4c80-34c6-4c05-a9a7-9da023b7bc0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:27:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:54 user nova-compute[75071]: INFO nova.compute.manager [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Attaching volume b38a3474-54a6-46f6-9bca-550ec014db37 to /dev/vdb
Nov 29 13:27:54 user nova-compute[75071]: DEBUG os_brick.utils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[614d2840-175a-4fd3-8a2c-a3f701d3ade5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[351c3e8f-aed1-41b6-afaa-b20d70d90a47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f9ad2-5d0d-4bc1-a4b2-8f8a9924329a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb800c55-ae86-4c8b-8627-cb1a7571ed3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk 1073741824" returned: 0 in 0.096s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:27:54 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31f0ca3-1b70-4d34-b847-7ec94fe2c1db]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG os_brick.utils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== get_connector_properties: return (241ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating existing volume attachment record: fb578fda-87aa-45a7-801a-3f4b863f74e4 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Successfully created port: 2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Cannot resize image /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Ensure instance console log exists: /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Successfully updated port: 2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:27:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquired lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:27:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-changed-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Refreshing instance network info cache due to event network-changed-2a2c6093-ffca-45b4-95f9-b612afba26a5. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] Acquiring lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating instance_info_cache with network_info: [{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Releasing lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance network_info: |[{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] Acquired lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Refreshing network info cache for port 2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Start _get_guest_xml network_info=[{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:27:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'pci_devices' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:27:56 user nova-compute[75071]:   <uuid>f9101862-4ab0-4973-84a7-411ab276084d</uuid>
Nov 29 13:27:56 user nova-compute[75071]:   <name>instance-00000019</name>
Nov 29 13:27:56 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:27:56 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:27:56 user nova-compute[75071]:   <metadata>
Nov 29 13:27:56 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:27:56 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:27:56 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-489273326</nova:name>
Nov 29 13:27:56 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:27:56</nova:creationTime>
Nov 29 13:27:56 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:27:56 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:27:56 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:27:56 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:27:56 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:27:56 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:27:56 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:27:56 user nova-compute[75071]:       <nova:owner>
Nov 29 13:27:56 user nova-compute[75071]:         <nova:user uuid="80b78150bab7440daf6d7fe0d25d4cf2">tempest-AttachVolumeTestJSON-964246432-project-member</nova:user>
Nov 29 13:27:56 user nova-compute[75071]:         <nova:project uuid="9fead1ec3dc0456eb2dd2290009247a9">tempest-AttachVolumeTestJSON-964246432</nova:project>
Nov 29 13:27:56 user nova-compute[75071]:       </nova:owner>
Nov 29 13:27:56 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:27:56 user nova-compute[75071]:       <nova:ports>
Nov 29 13:27:56 user nova-compute[75071]:         <nova:port uuid="2a2c6093-ffca-45b4-95f9-b612afba26a5">
Nov 29 13:27:56 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:27:56 user nova-compute[75071]:         </nova:port>
Nov 29 13:27:56 user nova-compute[75071]:       </nova:ports>
Nov 29 13:27:56 user nova-compute[75071]:     </nova:instance>
Nov 29 13:27:56 user nova-compute[75071]:   </metadata>
Nov 29 13:27:56 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:27:56 user nova-compute[75071]:     <system>
Nov 29 13:27:56 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:27:56 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:27:56 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:27:56 user nova-compute[75071]:       <entry name="serial">f9101862-4ab0-4973-84a7-411ab276084d</entry>
Nov 29 13:27:56 user nova-compute[75071]:       <entry name="uuid">f9101862-4ab0-4973-84a7-411ab276084d</entry>
Nov 29 13:27:56 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:27:56 user nova-compute[75071]:     </system>
Nov 29 13:27:56 user nova-compute[75071]:   </sysinfo>
Nov 29 13:27:56 user nova-compute[75071]:   <os>
Nov 29 13:27:56 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:27:56 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:27:56 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:27:56 user nova-compute[75071]:   </os>
Nov 29 13:27:56 user nova-compute[75071]:   <features>
Nov 29 13:27:56 user nova-compute[75071]:     <acpi/>
Nov 29 13:27:56 user nova-compute[75071]:     <apic/>
Nov 29 13:27:56 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:27:56 user nova-compute[75071]:   </features>
Nov 29 13:27:56 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:27:56 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:27:56 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:27:56 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:27:56 user nova-compute[75071]:   </clock>
Nov 29 13:27:56 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:27:56 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:27:56 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:27:56 user nova-compute[75071]:   </cpu>
Nov 29 13:27:56 user nova-compute[75071]:   <devices>
Nov 29 13:27:56 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:27:56 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:27:56 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk"/>
Nov 29 13:27:56 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:27:56 user nova-compute[75071]:     </disk>
Nov 29 13:27:56 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:27:56 user nova-compute[75071]:       <mac address="fa:16:3e:a4:e6:92"/>
Nov 29 13:27:56 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:27:56 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:27:56 user nova-compute[75071]:       <target dev="tap2a2c6093-ff"/>
Nov 29 13:27:56 user nova-compute[75071]:     </interface>
Nov 29 13:27:56 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:27:56 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/console.log" append="off"/>
Nov 29 13:27:56 user nova-compute[75071]:     </serial>
Nov 29 13:27:56 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:27:56 user nova-compute[75071]:     <video>
Nov 29 13:27:56 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:27:56 user nova-compute[75071]:     </video>
Nov 29 13:27:56 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:27:56 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:27:56 user nova-compute[75071]:     </rng>
Nov 29 13:27:56 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:27:56 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:27:56 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:27:56 user nova-compute[75071]:     </memballoon>
Nov 29 13:27:56 user nova-compute[75071]:   </devices>
Nov 29 13:27:56 user nova-compute[75071]: </domain>
Nov 29 13:27:56 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:27:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG os_vif [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bf45b21-28d5-5af4-9a3b-34a7225378fa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a2c6093-ff, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a2c6093-ff, col_values=(('qos', UUID('eb4c5fe7-8a07-4897-b506-ba1ec0d3bb92')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a2c6093-ff, col_values=(('external_ids', {'iface-id': '2a2c6093-ffca-45b4-95f9-b612afba26a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:e6:92', 'vm-uuid': 'f9101862-4ab0-4973-84a7-411ab276084d'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:56 user nova-compute[75071]: INFO os_vif [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff')
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No VIF found with MAC fa:16:3e:a4:e6:92, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updated VIF entry in instance network info cache for port 2a2c6093-ffca-45b4-95f9-b612afba26a5. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating instance_info_cache with network_info: [{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d407284f-3da3-4312-83e5-c1045006cfea req-46116271-158f-4a0e-b3a3-c395dd5247e2 service nova] Releasing lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updating instance_info_cache with network_info: [{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-84e9c654-1064-4bb7-aaa4-955d1028f212 req-68fef1bd-6af9-47d8-b5b6-19a76048e5ec service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84e9c654-1064-4bb7-aaa4-955d1028f212 req-68fef1bd-6af9-47d8-b5b6-19a76048e5ec service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84e9c654-1064-4bb7-aaa4-955d1028f212 req-68fef1bd-6af9-47d8-b5b6-19a76048e5ec service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84e9c654-1064-4bb7-aaa4-955d1028f212 req-68fef1bd-6af9-47d8-b5b6-19a76048e5ec service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-84e9c654-1064-4bb7-aaa4-955d1028f212 req-68fef1bd-6af9-47d8-b5b6-19a76048e5ec service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:27:58 user nova-compute[75071]: WARNING nova.compute.manager [req-84e9c654-1064-4bb7-aaa4-955d1028f212 req-68fef1bd-6af9-47d8-b5b6-19a76048e5ec service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state building and task_state spawning.
Nov 29 13:27:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:27:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca320573-529b-410d-93f8-e8c1234e7ad3 req-454fe3d3-ec2a-43d9-b280-3ae0ab2a6bd5 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca320573-529b-410d-93f8-e8c1234e7ad3 req-454fe3d3-ec2a-43d9-b280-3ae0ab2a6bd5 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca320573-529b-410d-93f8-e8c1234e7ad3 req-454fe3d3-ec2a-43d9-b280-3ae0ab2a6bd5 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca320573-529b-410d-93f8-e8c1234e7ad3 req-454fe3d3-ec2a-43d9-b280-3ae0ab2a6bd5 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca320573-529b-410d-93f8-e8c1234e7ad3 req-454fe3d3-ec2a-43d9-b280-3ae0ab2a6bd5 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:00 user nova-compute[75071]: WARNING nova.compute.manager [req-ca320573-529b-410d-93f8-e8c1234e7ad3 req-454fe3d3-ec2a-43d9-b280-3ae0ab2a6bd5 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state building and task_state spawning.
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:28:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance spawned successfully.
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:00 user nova-compute[75071]: INFO nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 29 13:28:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:28:00 user nova-compute[75071]: INFO nova.compute.manager [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Took 9.18 seconds to build instance.
Nov 29 13:28:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4296f52-ec9e-4a5e-96cf-38addca25f81 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.300s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrTLYKko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:07 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[555eb8fe-ae26-445c-afe5-1069ea023a53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:28:07 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db55cb00-f32b-481c-ba62-7342263f52b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37] added
Nov 29 13:28:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddeeafb-7745-4475-9e41-63dc0af89ff0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256e2cd-8098-4001-bade-e240fb22877a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrTLYKko {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrTLYKko" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a692c3-0f87-4c28-82e5-13b076af8003]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZrTLYKko'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c089e404-2a7d-4b9d-9163-4d7a68b8978f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccdbd6f-d71d-46ed-9512-2d5efde67a44]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d570ec-9576-488b-aed4-2cd6846c6029]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260]
Nov 29 13:28:07 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260] successful.
Nov 29 13:28:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca92c1ce-d6c5-4ddd-95ff-d894b68be359]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba0da0c-2333-45a6-8bc2-5598e5624c8c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d47e8f-1ecb-4faa-9db7-ebeb21dc8747]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrTLYKko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23834616635356266', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834616635356266', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:28:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'flavor' on Instance uuid 0c6a1702-5e65-4648-915d-2186ca6fc54c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:28:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:28:08 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:28:08 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:28:08 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:28:08 user nova-compute[75071]:   <serial>b38a3474-54a6-46f6-9bca-550ec014db37</serial>
Nov 29 13:28:08 user nova-compute[75071]: </disk>
Nov 29 13:28:08 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:28:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:28:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:28:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] No VIF found with MAC fa:16:3e:4f:6c:97, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c962c22e-5397-4ddb-a88b-eb157b5555ff tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.207s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing instance network info cache due to event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:28:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] Acquiring lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:28:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] Acquired lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:28:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updated VIF entry in instance network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-95f29ce1-b105-45d2-a514-eae4d169a24f req-a3ee1495-4dfd-455c-a41e-935d5cab6985 service nova] Releasing lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:13 user nova-compute[75071]: INFO nova.compute.manager [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Terminating instance
Nov 29 13:28:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Instance destroyed successfully.
Nov 29 13:28:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'resources' on Instance uuid a1c074cd-4c13-4dc5-80fe-c05c637d3ac8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-617762259',display_name='tempest-AttachVolumeNegativeTest-server-617762259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-617762259',id=15,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg/24yq2PdKwTK7pXat8VN8Xord8EXc1BUB3MUHbwlcRI0y3aIlLNnAYVtkCEPLkvZI1DXszOR/5dyeODZcDGYycIa9uHL6VNXZs6TJCK7qI7P2/a3pLbAaqL8wYJT7pg==',key_name='tempest-keypair-428284518',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:22:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-kql42uam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=a1c074cd-4c13-4dc5-80fe-c05c637d3ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "6049ab99-d0e5-4db3-85e3-927718b9092e", "address": "fa:16:3e:c4:bc:e0", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6049ab99-d0", "ovs_interfaceid": "6049ab99-d0e5-4db3-85e3-927718b9092e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=6049ab99-d0e5-4db3-85e3-927718b9092e,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6049ab99-d0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG os_vif [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=6049ab99-d0e5-4db3-85e3-927718b9092e,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6049ab99-d0') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6049ab99-d0, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3849e479-2334-435f-a7f7-2b845244d44f) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:14 user nova-compute[75071]: INFO os_vif [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=6049ab99-d0e5-4db3-85e3-927718b9092e,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6049ab99-d0')
Nov 29 13:28:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Deleting instance files /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8_del
Nov 29 13:28:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Deletion of /opt/stack/data/nova/instances/a1c074cd-4c13-4dc5-80fe-c05c637d3ac8_del complete
Nov 29 13:28:14 user nova-compute[75071]: INFO nova.compute.manager [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 13:28:14 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:28:14 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-a34d0410-cfd4-424c-8e9e-ec9b3e83791c req-53c44874-0e30-4056-84aa-f02228bbd2cc service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-vif-unplugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a34d0410-cfd4-424c-8e9e-ec9b3e83791c req-53c44874-0e30-4056-84aa-f02228bbd2cc service nova] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a34d0410-cfd4-424c-8e9e-ec9b3e83791c req-53c44874-0e30-4056-84aa-f02228bbd2cc service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a34d0410-cfd4-424c-8e9e-ec9b3e83791c req-53c44874-0e30-4056-84aa-f02228bbd2cc service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-a34d0410-cfd4-424c-8e9e-ec9b3e83791c req-53c44874-0e30-4056-84aa-f02228bbd2cc service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] No waiting events found dispatching network-vif-unplugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-a34d0410-cfd4-424c-8e9e-ec9b3e83791c req-53c44874-0e30-4056-84aa-f02228bbd2cc service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-vif-unplugged-6049ab99-d0e5-4db3-85e3-927718b9092e for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:28:15 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:15 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Took 1.70 seconds to deallocate network for instance.
Nov 29 13:28:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:16 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Deleted allocations for instance a1c074cd-4c13-4dc5-80fe-c05c637d3ac8
Nov 29 13:28:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcebb999-6c73-4e83-8f81-d387e6f92197 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing instance network info cache due to event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] Acquiring lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] Acquired lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:28:16 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:17 user nova-compute[75071]: INFO nova.compute.manager [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Rebooting instance
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updated VIF entry in instance network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cc2f270e-0e66-4412-92df-5abdfd1b2b0d req-f9ea2280-a61f-4bcb-9c45-6f9e12e2aae3 service nova] Releasing lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquired lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-14256110-d752-480e-8192-69e5c1053045 req-300569c9-61b9-455d-8865-6a66c80dc2a2 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14256110-d752-480e-8192-69e5c1053045 req-300569c9-61b9-455d-8865-6a66c80dc2a2 service nova] Acquiring lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14256110-d752-480e-8192-69e5c1053045 req-300569c9-61b9-455d-8865-6a66c80dc2a2 service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14256110-d752-480e-8192-69e5c1053045 req-300569c9-61b9-455d-8865-6a66c80dc2a2 service nova] Lock "a1c074cd-4c13-4dc5-80fe-c05c637d3ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-14256110-d752-480e-8192-69e5c1053045 req-300569c9-61b9-455d-8865-6a66c80dc2a2 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] No waiting events found dispatching network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:17 user nova-compute[75071]: WARNING nova.compute.manager [req-14256110-d752-480e-8192-69e5c1053045 req-300569c9-61b9-455d-8865-6a66c80dc2a2 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received unexpected event network-vif-plugged-6049ab99-d0e5-4db3-85e3-927718b9092e for instance with vm_state deleted and task_state None.
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-14256110-d752-480e-8192-69e5c1053045 req-300569c9-61b9-455d-8865-6a66c80dc2a2 service nova] [instance: a1c074cd-4c13-4dc5-80fe-c05c637d3ac8] Received event network-vif-deleted-6049ab99-d0e5-4db3-85e3-927718b9092e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Releasing lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:28:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:28:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-776e27da-4549-4846-bb40-f67d77eefae7 req-8bebd79b-15a2-4881-ae7d-3089b2267706 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-776e27da-4549-4846-bb40-f67d77eefae7 req-8bebd79b-15a2-4881-ae7d-3089b2267706 service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-776e27da-4549-4846-bb40-f67d77eefae7 req-8bebd79b-15a2-4881-ae7d-3089b2267706 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-776e27da-4549-4846-bb40-f67d77eefae7 req-8bebd79b-15a2-4881-ae7d-3089b2267706 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-776e27da-4549-4846-bb40-f67d77eefae7 req-8bebd79b-15a2-4881-ae7d-3089b2267706 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:20 user nova-compute[75071]: WARNING nova.compute.manager [req-776e27da-4549-4846-bb40-f67d77eefae7 req-8bebd79b-15a2-4881-ae7d-3089b2267706 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance shutdown successfully.
Nov 29 13:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:22 user nova-compute[75071]: WARNING nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:22 user nova-compute[75071]: WARNING nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:22 user nova-compute[75071]: WARNING nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:22 user nova-compute[75071]: WARNING nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:22 user nova-compute[75071]: WARNING nova.compute.manager [req-83337e26-76e7-4eee-b0a7-8fd74dc47efa req-f63d3ada-76a4-4bf5-a4c0-d4410f1a671a service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:24 user nova-compute[75071]: WARNING nova.compute.manager [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:24 user nova-compute[75071]: WARNING nova.compute.manager [req-20805e39-bca5-4c5e-9bf8-7df70f7535ea req-8e362157-4cd9-4ebd-aefa-1d1244a1f9aa service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state active and task_state reboot_started.
Nov 29 13:28:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance running successfully.
Nov 29 13:28:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance soft rebooted successfully.
Nov 29 13:28:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:28:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7efcdb81-2476-412e-81a5-8408fc38a502 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.106s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lazy-loading 'flavor' on Instance uuid e87c6f07-62b2-4fd6-a51f-4551a41b4e3d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:34 user nova-compute[75071]: INFO nova.compute.manager [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Attaching volume 9b08419e-74f2-4799-8b08-e874ef9b33cd to /dev/vdb
Nov 29 13:28:34 user nova-compute[75071]: DEBUG os_brick.utils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cc8cc5-63d3-4785-8542-6a02647d1d79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13321e2f-1605-48e4-8ab1-808f0cf77fdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a014daf-df50-48e6-92ff-d0d903d0c405]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dacdb6-ee2d-4f36-b595-a55b49d8d43b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:28:35 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:28:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9088e6-9c78-4908-9cfa-f77453d5b5c8]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG os_brick.utils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:35 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Updating existing volume attachment record: 17b79a4f-a245-4236-a9e8-ec2463586ccf {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:28:37 user nova-compute[75071]: INFO nova.compute.claims [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Claim successful on node user
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:28:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:28:37 user nova-compute[75071]: DEBUG nova.policy [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32b037a2bbef4090a2317bfeedd8e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b75ecae6764ce1801dbab6253ac6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:28:37 user nova-compute[75071]: INFO nova.virt.block_device [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Booting with volume snapshot aa79b24e-a0d1-4e6f-bfce-d75cedc008bf at /dev/vda
Nov 29 13:28:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Successfully created port: 29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Successfully updated port: 29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "refresh_cache-3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquired lock "refresh_cache-3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received event network-changed-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Refreshing instance network info cache due to event network-changed-29b0abef-6785-42cc-8538-7de623508452. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] Acquiring lock "refresh_cache-3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Updating instance_info_cache with network_info: [{"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Releasing lock "refresh_cache-3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Instance network_info: |[{"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] Acquired lock "refresh_cache-3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:28:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Refreshing network info cache for port 29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:28:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Updated VIF entry in instance network info cache for port 29b0abef-6785-42cc-8538-7de623508452. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:28:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Updating instance_info_cache with network_info: [{"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-31e9ea8a-92f3-49fd-9ea6-92e12ed784cb req-678e04bb-7133-4fac-8fc6-8ef184eff610 service nova] Releasing lock "refresh_cache-3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:28:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyvFNtPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:43 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98af94ae-90e6-483b-92f0-a7389c9d943a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:28:43 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40c762-941e-4722-90ea-4d1633172d49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd] added
Nov 29 13:28:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.utils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[271f5873-7c2a-4bb9-90f4-cd2d368e5783]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0035f3da-8057-4c4c-9bc3-9c4702a56b18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfae4c50-42ed-4616-8228-749bf0cb3afa]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyvFNtPV {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aa5944-3edf-40db-8a7b-6905517148f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyvFNtPV" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9354b669-3be8-4000-bba1-98c0bbc99f83]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dyvFNtPV'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14839389-c0db-4b54-9a34-81c9dd7e2375]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3f60a6-bf12-4b88-897d-4d3d77f1dda2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a739851-c96f-4c9b-89f0-5dcfce4a1fa6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:28:43 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[585a6f8f-aa4e-4044-9537-b204b5b27690]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.utils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Updating existing volume attachment record: ccf4e76e-9a2a-4283-8d23-039a03f52fbd {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8247850-d397-472e-bde4-98938eef69e5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01963e9f-dbc2-4aef-895b-31d61f9c7413]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260]
Nov 29 13:28:43 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260] successful.
Nov 29 13:28:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f854b2-da63-407a-a8c1-2cbba6cd3064]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25991e2-5ba8-4d7d-a463-2b9aa910bd0e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd (non-flash)
Nov 29 13:28:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:43 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd (non-flash)
Nov 29 13:28:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:28:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f16a2f-3297-4437-80e1-9e96f3cdc339]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyvFNtPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:28:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23661356165383438', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661356165383438', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lazy-loading 'flavor' on Instance uuid e87c6f07-62b2-4fd6-a51f-4551a41b4e3d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:28:45 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:28:45 user nova-compute[75071]:   <source dev="/dev/sde"/>
Nov 29 13:28:45 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:28:45 user nova-compute[75071]:   <serial>9b08419e-74f2-4799-8b08-e874ef9b33cd</serial>
Nov 29 13:28:45 user nova-compute[75071]: </disk>
Nov 29 13:28:45 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] No VIF found with MAC fa:16:3e:d9:77:e8, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-53c98370-353e-4b3d-9127-c783f4f80fd7 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.741s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:45 user nova-compute[75071]: INFO nova.compute.manager [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Terminating instance
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-66c6511e-c2f5-44af-a704-65876206af08 req-0b31203c-287f-4283-bc4e-fae7b2206522 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received event network-vif-unplugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66c6511e-c2f5-44af-a704-65876206af08 req-0b31203c-287f-4283-bc4e-fae7b2206522 service nova] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66c6511e-c2f5-44af-a704-65876206af08 req-0b31203c-287f-4283-bc4e-fae7b2206522 service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66c6511e-c2f5-44af-a704-65876206af08 req-0b31203c-287f-4283-bc4e-fae7b2206522 service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-66c6511e-c2f5-44af-a704-65876206af08 req-0b31203c-287f-4283-bc4e-fae7b2206522 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] No waiting events found dispatching network-vif-unplugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-66c6511e-c2f5-44af-a704-65876206af08 req-0b31203c-287f-4283-bc4e-fae7b2206522 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received event network-vif-unplugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:28:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Instance destroyed successfully.
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lazy-loading 'resources' on Instance uuid e87c6f07-62b2-4fd6-a51f-4551a41b4e3d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:26:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2068630957',display_name='tempest-DeleteServersTestJSON-server-2068630957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2068630957',id=23,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:26:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d66be1e4f2df45db96d3da55f270eff8',ramdisk_id='',reservation_id='r-yrqhsn40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1382165334',owner_user_name='tempest-DeleteServersTestJSON-1382165334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:26:49Z,user_data=None,user_id='524871ebdef24e6bad499aac8cc40a9e',uuid=e87c6f07-62b2-4fd6-a51f-4551a41b4e3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Converting VIF {"id": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "address": "fa:16:3e:d9:77:e8", "network": {"id": "2f075df5-29d0-49b4-9118-af95637cbd9f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1399277305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d66be1e4f2df45db96d3da55f270eff8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0ce0f2-12", "ovs_interfaceid": "ce0ce0f2-1284-4fc7-8944-d923ef911b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:77:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce0ce0f2-1284-4fc7-8944-d923ef911b5f,network=Network(2f075df5-29d0-49b4-9118-af95637cbd9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0ce0f2-12') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_vif [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:77:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce0ce0f2-1284-4fc7-8944-d923ef911b5f,network=Network(2f075df5-29d0-49b4-9118-af95637cbd9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0ce0f2-12') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce0ce0f2-12, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d260e16e-4780-4b18-8c0c-ebba6ae823ca) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:28:46 user nova-compute[75071]: INFO os_vif [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:77:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce0ce0f2-1284-4fc7-8944-d923ef911b5f,network=Network(2f075df5-29d0-49b4-9118-af95637cbd9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0ce0f2-12')
Nov 29 13:28:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyvFNtPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:46 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[879480f7-9afb-4dc7-bd8d-60952b6b6f12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:28:46 user nova-compute[75071]: No targets found.
Nov 29 13:28:46 user nova-compute[75071]: iSNS:
Nov 29 13:28:46 user nova-compute[75071]: No targets found.
Nov 29 13:28:46 user nova-compute[75071]: STATIC:
Nov 29 13:28:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1
Nov 29 13:28:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:46 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37
Nov 29 13:28:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:46 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd
Nov 29 13:28:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:46 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:28:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:46 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:46 user nova-compute[75071]: FIRMWARE:
Nov 29 13:28:46 user nova-compute[75071]: No targets found.
Nov 29 13:28:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:28:46 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:28:46 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bf7f8b-c4d5-46c6-8f47-4f5d53e14ba2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad539105-0ce6-45e4-a604-0e32f8204f9f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:46 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:46 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:46 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd (non-flash)
Nov 29 13:28:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:46 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:46 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:46 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd (non-flash)
Nov 29 13:28:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f214848d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ce7f9-3f6e-4ec5-9497-61292d09b6e2]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd52b606-407f-45ce-ac88-43ed9bbc1bf2]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50329a1-7600-4665-97a9-fd2f2ea365c9]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b00501-08c0-468d-8b3f-08f9c8e23574]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d9cc9e-0170-45c6-83f5-9d69350b2d3e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e7ee0a-0905-4219-9bdc-b5179ec0a2bf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260]
Nov 29 13:28:47 user nova-compute[75071]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd, portal: 172.16.0.220,3260] successful.
Nov 29 13:28:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b08419e-74f2-4799-8b08-e874ef9b33cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f9225f-a6c2-49c0-b778-c18f403fd1cf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] <== disconnect_volume: return (377ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:28:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Deleting instance files /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d_del
Nov 29 13:28:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Deletion of /opt/stack/data/nova/instances/e87c6f07-62b2-4fd6-a51f-4551a41b4e3d_del complete
Nov 29 13:28:47 user nova-compute[75071]: INFO nova.compute.manager [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:47 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Took 0.59 seconds to deallocate network for instance.
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:28:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid 'e87c6f07-62b2-4fd6-a51f-4551a41b4e3d' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e87c6f07-62b2-4fd6-a51f-4551a41b4e3d' (instance-00000017)
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-a54b0f99-c45f-46ac-bc7b-4fa911c4ed15 req-c7638a26-f997-4465-b558-13ec61d40a77 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received event network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a54b0f99-c45f-46ac-bc7b-4fa911c4ed15 req-c7638a26-f997-4465-b558-13ec61d40a77 service nova] Acquiring lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a54b0f99-c45f-46ac-bc7b-4fa911c4ed15 req-c7638a26-f997-4465-b558-13ec61d40a77 service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a54b0f99-c45f-46ac-bc7b-4fa911c4ed15 req-c7638a26-f997-4465-b558-13ec61d40a77 service nova] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-a54b0f99-c45f-46ac-bc7b-4fa911c4ed15 req-c7638a26-f997-4465-b558-13ec61d40a77 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] No waiting events found dispatching network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:48 user nova-compute[75071]: WARNING nova.compute.manager [req-a54b0f99-c45f-46ac-bc7b-4fa911c4ed15 req-c7638a26-f997-4465-b558-13ec61d40a77 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received unexpected event network-vif-plugged-ce0ce0f2-1284-4fc7-8944-d923ef911b5f for instance with vm_state active and task_state deleting.
Nov 29 13:28:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-a54b0f99-c45f-46ac-bc7b-4fa911c4ed15 req-c7638a26-f997-4465-b558-13ec61d40a77 service nova] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Received event network-vif-deleted-ce0ce0f2-1284-4fc7-8944-d923ef911b5f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:48 user nova-compute[75071]: INFO nova.compute.manager [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] [instance: e87c6f07-62b2-4fd6-a51f-4551a41b4e3d] Took 1.12 seconds to detach 1 volumes for instance.
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:28:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:28:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7847MB free_disk=25.082225799560547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:49 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Deleted allocations for instance e87c6f07-62b2-4fd6-a51f-4551a41b4e3d
Nov 29 13:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5f71784a-2e99-4175-a42a-59f58a8a3734 tempest-DeleteServersTestJSON-1382165334 tempest-DeleteServersTestJSON-1382165334-project-member] Lock "e87c6f07-62b2-4fd6-a51f-4551a41b4e3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.199s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0c6a1702-5e65-4648-915d-2186ca6fc54c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 003e4c80-34c6-4c05-a9a7-9da023b7bc0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:28:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:28:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:28:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Creating image(s)
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Ensure instance console log exists: /opt/stack/data/nova/instances/3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Start _get_guest_xml network_info=[{"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUMOBrfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3', 'attached_at': '', 'detached_at': '', 'volume_id': '1f441f8e-9e6d-4f31-a015-e66cfe55e6b6', 'serial': '1f441f8e-9e6d-4f31-a015-e66cfe55e6b6'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'ccf4e76e-9a2a-4283-8d23-039a03f52fbd', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:28:52 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:28:52 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUMOBrfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:52 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:52 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:52 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462e88c-9c22-436d-a608-f16048bc3143]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:28:52 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2fe02e-0628-42f0-9404-e079fbf1ee23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6] added
Nov 29 13:28:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0905b32b-5481-49f6-a7c5-c94b65b020b4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dfd634-d5cd-43d0-b949-90fb8eb37b22]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUMOBrfD {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CUMOBrfD" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd4f933-8eef-4b97-8ef4-7791d4b84a00]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CUMOBrfD'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cb6b08-43bd-4723-aaac-c53c82c10833]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[64438937-4401-4311-9e5c-0806b15f26f6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6b2ed-eb32-4088-909a-7bbb6abb0339]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260]
Nov 29 13:28:52 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260] successful.
Nov 29 13:28:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da613b12-3077-4b7f-a09c-91c4a1e992b5]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[10349720-e1f0-4104-8a3f-15dd2876afaa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:28:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad59a7-e722-449f-98d4-060e24079e53]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUMOBrfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:28:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26364303036653861', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364303036653861', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1723757508',display_name='tempest-TestVolumeBootPattern-server-1723757508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1723757508',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-no9kauw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:28:38Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:51:af,bridge_name='br-int',has_traffic_filtering=True,id=29b0abef-6785-42cc-8538-7de623508452,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0abef-67') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:28:53 user nova-compute[75071]:   <uuid>3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3</uuid>
Nov 29 13:28:53 user nova-compute[75071]:   <name>instance-0000001a</name>
Nov 29 13:28:53 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:28:53 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:28:53 user nova-compute[75071]:   <metadata>
Nov 29 13:28:53 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:28:53 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:28:53 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-1723757508</nova:name>
Nov 29 13:28:53 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:28:52</nova:creationTime>
Nov 29 13:28:53 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:28:53 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:28:53 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:28:53 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:28:53 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:28:53 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:28:53 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:28:53 user nova-compute[75071]:       <nova:owner>
Nov 29 13:28:53 user nova-compute[75071]:         <nova:user uuid="32b037a2bbef4090a2317bfeedd8e155">tempest-TestVolumeBootPattern-2055293783-project-member</nova:user>
Nov 29 13:28:53 user nova-compute[75071]:         <nova:project uuid="86b75ecae6764ce1801dbab6253ac6c4">tempest-TestVolumeBootPattern-2055293783</nova:project>
Nov 29 13:28:53 user nova-compute[75071]:       </nova:owner>
Nov 29 13:28:53 user nova-compute[75071]:       <nova:ports>
Nov 29 13:28:53 user nova-compute[75071]:         <nova:port uuid="29b0abef-6785-42cc-8538-7de623508452">
Nov 29 13:28:53 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 13:28:53 user nova-compute[75071]:         </nova:port>
Nov 29 13:28:53 user nova-compute[75071]:       </nova:ports>
Nov 29 13:28:53 user nova-compute[75071]:     </nova:instance>
Nov 29 13:28:53 user nova-compute[75071]:   </metadata>
Nov 29 13:28:53 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:28:53 user nova-compute[75071]:     <system>
Nov 29 13:28:53 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:28:53 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:28:53 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:28:53 user nova-compute[75071]:       <entry name="serial">3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3</entry>
Nov 29 13:28:53 user nova-compute[75071]:       <entry name="uuid">3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3</entry>
Nov 29 13:28:53 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:28:53 user nova-compute[75071]:     </system>
Nov 29 13:28:53 user nova-compute[75071]:   </sysinfo>
Nov 29 13:28:53 user nova-compute[75071]:   <os>
Nov 29 13:28:53 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:28:53 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:28:53 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:28:53 user nova-compute[75071]:   </os>
Nov 29 13:28:53 user nova-compute[75071]:   <features>
Nov 29 13:28:53 user nova-compute[75071]:     <acpi/>
Nov 29 13:28:53 user nova-compute[75071]:     <apic/>
Nov 29 13:28:53 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:28:53 user nova-compute[75071]:   </features>
Nov 29 13:28:53 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:28:53 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:28:53 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:28:53 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:28:53 user nova-compute[75071]:   </clock>
Nov 29 13:28:53 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:28:53 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:28:53 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:28:53 user nova-compute[75071]:   </cpu>
Nov 29 13:28:53 user nova-compute[75071]:   <devices>
Nov 29 13:28:53 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:28:53 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:28:53 user nova-compute[75071]:       <source dev="/dev/sde"/>
Nov 29 13:28:53 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:28:53 user nova-compute[75071]:       <serial>1f441f8e-9e6d-4f31-a015-e66cfe55e6b6</serial>
Nov 29 13:28:53 user nova-compute[75071]:     </disk>
Nov 29 13:28:53 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:28:53 user nova-compute[75071]:       <mac address="fa:16:3e:fb:51:af"/>
Nov 29 13:28:53 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:28:53 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:28:53 user nova-compute[75071]:       <target dev="tap29b0abef-67"/>
Nov 29 13:28:53 user nova-compute[75071]:     </interface>
Nov 29 13:28:53 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:28:53 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3/console.log" append="off"/>
Nov 29 13:28:53 user nova-compute[75071]:     </serial>
Nov 29 13:28:53 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:28:53 user nova-compute[75071]:     <video>
Nov 29 13:28:53 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:28:53 user nova-compute[75071]:     </video>
Nov 29 13:28:53 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:28:53 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:28:53 user nova-compute[75071]:     </rng>
Nov 29 13:28:53 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:28:53 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:28:53 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:28:53 user nova-compute[75071]:     </memballoon>
Nov 29 13:28:53 user nova-compute[75071]:   </devices>
Nov 29 13:28:53 user nova-compute[75071]: </domain>
Nov 29 13:28:53 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1723757508',display_name='tempest-TestVolumeBootPattern-server-1723757508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1723757508',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-no9kauw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:28:38Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:51:af,bridge_name='br-int',has_traffic_filtering=True,id=29b0abef-6785-42cc-8538-7de623508452,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0abef-67') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG os_vif [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:51:af,bridge_name='br-int',has_traffic_filtering=True,id=29b0abef-6785-42cc-8538-7de623508452,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0abef-67') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7582a6c6-d318-5d4f-8733-49043795802b', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29b0abef-67, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29b0abef-67, col_values=(('qos', UUID('a2b285c3-b3c5-493c-aa8b-aedac855220f')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29b0abef-67, col_values=(('external_ids', {'iface-id': '29b0abef-6785-42cc-8538-7de623508452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:51:af', 'vm-uuid': '3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:53 user nova-compute[75071]: INFO os_vif [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:51:af,bridge_name='br-int',has_traffic_filtering=True,id=29b0abef-6785-42cc-8538-7de623508452,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0abef-67')
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:28:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No VIF found with MAC fa:16:3e:fb:51:af, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:28:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-16aa0d18-9eb7-4aa6-9fec-55a70b3e9649 req-dbf7fbd8-34a2-488a-b689-f41fb59bfb53 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received event network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-16aa0d18-9eb7-4aa6-9fec-55a70b3e9649 req-dbf7fbd8-34a2-488a-b689-f41fb59bfb53 service nova] Acquiring lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-16aa0d18-9eb7-4aa6-9fec-55a70b3e9649 req-dbf7fbd8-34a2-488a-b689-f41fb59bfb53 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-16aa0d18-9eb7-4aa6-9fec-55a70b3e9649 req-dbf7fbd8-34a2-488a-b689-f41fb59bfb53 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-16aa0d18-9eb7-4aa6-9fec-55a70b3e9649 req-dbf7fbd8-34a2-488a-b689-f41fb59bfb53 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] No waiting events found dispatching network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-16aa0d18-9eb7-4aa6-9fec-55a70b3e9649 req-dbf7fbd8-34a2-488a-b689-f41fb59bfb53 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received unexpected event network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 for instance with vm_state building and task_state spawning.
Nov 29 13:28:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:56 user nova-compute[75071]: INFO nova.compute.manager [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Unshelving
Nov 29 13:28:56 user nova-compute[75071]: INFO nova.virt.block_device [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Booting with volume a934e1b5-90c2-413b-9e54-aa4e304d3944 at /dev/vdc
Nov 29 13:28:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b33617-9df8-4c1e-b291-cf9fecd8352a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[933bc92e-0d83-492e-9cf7-a870d5718c5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a350d57-1085-45de-9606-ecd080756c6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac99ff-c227-4a04-ad88-edf4ea9ec6de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:28:56 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd58119-86d6-4c4a-9666-7796d56d686c]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating existing volume attachment record: 05e28275-90a4-4cf4-b810-b1b3d5ec2cd9 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-changed-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Refreshing instance network info cache due to event network-changed-3b3aaef8-787e-4dcb-aa02-987d3920cb65. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] Acquiring lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] Acquired lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:28:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Refreshing network info cache for port 3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updated VIF entry in instance network info cache for port 3b3aaef8-787e-4dcb-aa02-987d3920cb65. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updating instance_info_cache with network_info: [{"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:28:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Instance spawned successfully.
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3cd79aec-9bd8-498f-aa2f-0478ec2eed79 req-deb91e77-728a-4949-9030-a294c57465f2 service nova] Releasing lock "refresh_cache-003e4c80-34c6-4c05-a9a7-9da023b7bc0e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:28:57 user nova-compute[75071]: INFO nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-fc9985ee-da0e-4886-9fea-6177fc8f7ab4 req-08525f56-d2c5-42d6-9f53-638727f3de15 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received event network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fc9985ee-da0e-4886-9fea-6177fc8f7ab4 req-08525f56-d2c5-42d6-9f53-638727f3de15 service nova] Acquiring lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fc9985ee-da0e-4886-9fea-6177fc8f7ab4 req-08525f56-d2c5-42d6-9f53-638727f3de15 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fc9985ee-da0e-4886-9fea-6177fc8f7ab4 req-08525f56-d2c5-42d6-9f53-638727f3de15 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-fc9985ee-da0e-4886-9fea-6177fc8f7ab4 req-08525f56-d2c5-42d6-9f53-638727f3de15 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] No waiting events found dispatching network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:57 user nova-compute[75071]: WARNING nova.compute.manager [req-fc9985ee-da0e-4886-9fea-6177fc8f7ab4 req-08525f56-d2c5-42d6-9f53-638727f3de15 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received unexpected event network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 for instance with vm_state building and task_state spawning.
Nov 29 13:28:57 user nova-compute[75071]: INFO nova.compute.manager [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Took 19.94 seconds to build instance.
Nov 29 13:28:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc2dd253-6052-46f2-acdd-51fda4a75257 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.057s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:57 user nova-compute[75071]: INFO nova.compute.manager [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Rebuilding instance
Nov 29 13:28:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f958bcc-30eb-4c05-a8f2-d9b1c6d21df3 req-166877cb-0676-4405-8ffe-3d71c6fd36bc service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-unplugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f958bcc-30eb-4c05-a8f2-d9b1c6d21df3 req-166877cb-0676-4405-8ffe-3d71c6fd36bc service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f958bcc-30eb-4c05-a8f2-d9b1c6d21df3 req-166877cb-0676-4405-8ffe-3d71c6fd36bc service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f958bcc-30eb-4c05-a8f2-d9b1c6d21df3 req-166877cb-0676-4405-8ffe-3d71c6fd36bc service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f958bcc-30eb-4c05-a8f2-d9b1c6d21df3 req-166877cb-0676-4405-8ffe-3d71c6fd36bc service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-unplugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:28:58 user nova-compute[75071]: WARNING nova.compute.manager [req-4f958bcc-30eb-4c05-a8f2-d9b1c6d21df3 req-166877cb-0676-4405-8ffe-3d71c6fd36bc service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received unexpected event network-vif-unplugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with vm_state active and task_state rebuilding.
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance destroyed successfully.
Nov 29 13:28:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance destroyed successfully.
Nov 29 13:28:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-172562232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2077791717',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfBnNA+l6YYtmYNkSg1+7s0Ze1ddryiQfXZLhNcjqMSj8oc5W03kR1glk/dkK9+JrmXvGkDbgD54809kDz8qwdonFyg6AQ17M2qJSInHDXXwV1R8WVChhaoXbQGyjkmag==',key_name='tempest-keypair-1963758755',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:27:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a5dedba01ce4e37a5b067def2eaea80',ramdisk_id='',reservation_id='r-25i14ftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1240456810',owner_user_name='tempest-ServerActionsV293TestJSON-1240456810-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6af3003b85a4cc281a9d2bbb9465fdb',uuid=003e4c80-34c6-4c05-a9a7-9da023b7bc0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converting VIF {"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_vif [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b3aaef8-78, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfd7f778-1de4-49e2-ae18-14fbe61d4657) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:28:58 user nova-compute[75071]: INFO os_vif [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78')
Nov 29 13:28:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c108c4-cc4e-47bf-b465-cfc0ebcdbcc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:28:58 user nova-compute[75071]: No targets found.
Nov 29 13:28:58 user nova-compute[75071]: iSNS:
Nov 29 13:28:58 user nova-compute[75071]: No targets found.
Nov 29 13:28:58 user nova-compute[75071]: STATIC:
Nov 29 13:28:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1
Nov 29 13:28:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:58 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37
Nov 29 13:28:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:58 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:28:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:58 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6
Nov 29 13:28:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:58 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:58 user nova-compute[75071]: FIRMWARE:
Nov 29 13:28:58 user nova-compute[75071]: No targets found.
Nov 29 13:28:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:28:58 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:28:58 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4223925e-3a15-4312-ac94-c09a5ebc7bd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc82708d-7b06-4097-839b-a4f179ff1539]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:28:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124db9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[455366f6-37db-445b-9769-e30174e762dd]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d491b958-a2b3-4913-b81b-be1dcb7cd504]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ae69a8-58be-44d5-800d-efd7ddfd2fda]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e66386-f2fc-4ed3-9bca-186103fb8883]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138396437643130', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ea975eb2', '/dev/disk/by-id/scsi-1SCST_BIOea975eb2-a89d7d10530b9b43') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e6fbce-3715-4dfe-88af-27da929519f6]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3568b4-b0d1-408c-a0b1-ea9fa671cc38]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b7943-a0d3-4511-ba7e-45a48f6b3d27]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]
Nov 29 13:28:58 user nova-compute[75071]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.
Nov 29 13:28:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[721a6d6c-606a-4eb1-a234-4a456e7b16f4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] <== disconnect_volume: return (355ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:28:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Deleting instance files /opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e_del
Nov 29 13:28:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Deletion of /opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e_del complete
Nov 29 13:28:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 003e4c80-34c6-4c05-a9a7-9da023b7bc0e could not be found.
Nov 29 13:28:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:28:59 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f85324-1fd1-4849-8975-deed72f47cf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:28:59 user nova-compute[75071]: No targets found.
Nov 29 13:28:59 user nova-compute[75071]: iSNS:
Nov 29 13:28:59 user nova-compute[75071]: No targets found.
Nov 29 13:28:59 user nova-compute[75071]: STATIC:
Nov 29 13:28:59 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37
Nov 29 13:28:59 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:59 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:59 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:28:59 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:59 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:59 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6
Nov 29 13:28:59 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:28:59 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:28:59 user nova-compute[75071]: FIRMWARE:
Nov 29 13:28:59 user nova-compute[75071]: No targets found.
Nov 29 13:28:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:28:59 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:28:59 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f51c726-96bd-46fb-95ff-9d55dde5dd0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaf5f93-4642-4c32-bb29-81b082525458]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:59 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:59 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:28:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:28:59 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:28:59 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:28:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e18310>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] <== disconnect_volume: return (70ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:28:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-1573c597-44dd-4961-9c3d-f9c53200499b req-f9318ef4-581d-4ec9-b3ac-abf18708c762 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1573c597-44dd-4961-9c3d-f9c53200499b req-f9318ef4-581d-4ec9-b3ac-abf18708c762 service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1573c597-44dd-4961-9c3d-f9c53200499b req-f9318ef4-581d-4ec9-b3ac-abf18708c762 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1573c597-44dd-4961-9c3d-f9c53200499b req-f9318ef4-581d-4ec9-b3ac-abf18708c762 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-1573c597-44dd-4961-9c3d-f9c53200499b req-f9318ef4-581d-4ec9-b3ac-abf18708c762 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:00 user nova-compute[75071]: WARNING nova.compute.manager [req-1573c597-44dd-4961-9c3d-f9c53200499b req-f9318ef4-581d-4ec9-b3ac-abf18708c762 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received unexpected event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with vm_state active and task_state rebuilding.
Nov 29 13:29:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Preparing to wait for external event volume-reimaged-45b95d97-ae9c-4e05-8ec4-7856a367f9b1 {{(pid=75071) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'pci_requests' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'numa_topology' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:04 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:29:04 user nova-compute[75071]: INFO nova.compute.claims [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Claim successful on node user
Nov 29 13:29:05 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:05 user nova-compute[75071]: INFO nova.network.neutron [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating port 8b97467c-89dd-4ec6-b403-1dcee24246e1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquired lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing instance network info cache due to event network-changed-8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:29:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] Acquiring lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Releasing lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:29:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Creating image(s)
Nov 29 13:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] Acquired lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Refreshing network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG nova.objects.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<73c90d9c-3089-4d7b-9ac9-7c2105cd4649> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "f74b8ea72d91aa9113a6155d2071493d35f98c9a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "f74b8ea72d91aa9113a6155d2071493d35f98c9a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG nova.virt.images [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] ec3e2055-27a0-4d2f-bf46-c5f170a4510a was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.part /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:29:07 user nova-compute[75071]: INFO nova.compute.claims [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Claim successful on node user
Nov 29 13:29:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updated VIF entry in instance network info cache for port 8b97467c-89dd-4ec6-b403-1dcee24246e1. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b6c9a69-1e1c-47c6-a561-88f3b9e7cf27 req-7190632c-1adf-4890-865d-a151b9c6372c service nova] Releasing lock "refresh_cache-73c90d9c-3089-4d7b-9ac9-7c2105cd4649" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.part /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.converted" returned: 0 in 1.134s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.151s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:29:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:29:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:29:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "f74b8ea72d91aa9113a6155d2071493d35f98c9a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.590s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.policy [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '350e0cf65eeb441582c203ac06668009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f00a9cd6fd4b4398314100706a720b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:29:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Creating image(s)
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "/opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "f74b8ea72d91aa9113a6155d2071493d35f98c9a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "f74b8ea72d91aa9113a6155d2071493d35f98c9a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a,backing_fmt=raw /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a,backing_fmt=raw /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk 1073741824" returned: 0 in 0.066s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "f74b8ea72d91aa9113a6155d2071493d35f98c9a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk 1073741824" returned: 0 in 0.057s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'migration_context' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.objects.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<73c90d9c-3089-4d7b-9ac9-7c2105cd4649> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:29:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Rebasing disk image.
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 -F raw /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Cannot resize image /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Ensure instance console log exists: /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Successfully created port: b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Successfully updated port: b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquired lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-changed-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Refreshing instance network info cache due to event network-changed-b987d810-7434-4a89-bcd5-7aa9cf6b7e35. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] Acquiring lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Updating instance_info_cache with network_info: [{"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Releasing lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Instance network_info: |[{"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] Acquired lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Refreshing network info cache for port b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Start _get_guest_xml network_info=[{"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:29:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-539973920',display_name='tempest-AttachVolumeNegativeTest-server-539973920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-539973920',id=27,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGl7B5wdgCUgm3qV6w64Nu6upkQaZw8I6LFuugjANNqs3yTD00NMmol9gtkFdRO/DHR1+1hJeWsSLyhU57hhpFMJurYlL2dL9A0aibHrKp8nye0gZSy+BfqGi5DKChd/Q==',key_name='tempest-keypair-236222793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-lf7h021t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=daa8724e-64a5-462a-8958-ac034d0b6721,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8f:99,bridge_name='br-int',has_traffic_filtering=True,id=b987d810-7434-4a89-bcd5-7aa9cf6b7e35,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987d810-74') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'pci_devices' on Instance uuid daa8724e-64a5-462a-8958-ac034d0b6721 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:29:11 user nova-compute[75071]:   <uuid>daa8724e-64a5-462a-8958-ac034d0b6721</uuid>
Nov 29 13:29:11 user nova-compute[75071]:   <name>instance-0000001b</name>
Nov 29 13:29:11 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:29:11 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:29:11 user nova-compute[75071]:   <metadata>
Nov 29 13:29:11 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:29:11 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:29:11 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-539973920</nova:name>
Nov 29 13:29:11 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:29:11</nova:creationTime>
Nov 29 13:29:11 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:29:11 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:29:11 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:29:11 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:29:11 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:29:11 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:29:11 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:29:11 user nova-compute[75071]:       <nova:owner>
Nov 29 13:29:11 user nova-compute[75071]:         <nova:user uuid="350e0cf65eeb441582c203ac06668009">tempest-AttachVolumeNegativeTest-1996696047-project-member</nova:user>
Nov 29 13:29:11 user nova-compute[75071]:         <nova:project uuid="f9f00a9cd6fd4b4398314100706a720b">tempest-AttachVolumeNegativeTest-1996696047</nova:project>
Nov 29 13:29:11 user nova-compute[75071]:       </nova:owner>
Nov 29 13:29:11 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:29:11 user nova-compute[75071]:       <nova:ports>
Nov 29 13:29:11 user nova-compute[75071]:         <nova:port uuid="b987d810-7434-4a89-bcd5-7aa9cf6b7e35">
Nov 29 13:29:11 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 13:29:11 user nova-compute[75071]:         </nova:port>
Nov 29 13:29:11 user nova-compute[75071]:       </nova:ports>
Nov 29 13:29:11 user nova-compute[75071]:     </nova:instance>
Nov 29 13:29:11 user nova-compute[75071]:   </metadata>
Nov 29 13:29:11 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:29:11 user nova-compute[75071]:     <system>
Nov 29 13:29:11 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:29:11 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:29:11 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:29:11 user nova-compute[75071]:       <entry name="serial">daa8724e-64a5-462a-8958-ac034d0b6721</entry>
Nov 29 13:29:11 user nova-compute[75071]:       <entry name="uuid">daa8724e-64a5-462a-8958-ac034d0b6721</entry>
Nov 29 13:29:11 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:29:11 user nova-compute[75071]:     </system>
Nov 29 13:29:11 user nova-compute[75071]:   </sysinfo>
Nov 29 13:29:11 user nova-compute[75071]:   <os>
Nov 29 13:29:11 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:29:11 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:29:11 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:29:11 user nova-compute[75071]:   </os>
Nov 29 13:29:11 user nova-compute[75071]:   <features>
Nov 29 13:29:11 user nova-compute[75071]:     <acpi/>
Nov 29 13:29:11 user nova-compute[75071]:     <apic/>
Nov 29 13:29:11 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:29:11 user nova-compute[75071]:   </features>
Nov 29 13:29:11 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:29:11 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:29:11 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:29:11 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:29:11 user nova-compute[75071]:   </clock>
Nov 29 13:29:11 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:29:11 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:29:11 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:29:11 user nova-compute[75071]:   </cpu>
Nov 29 13:29:11 user nova-compute[75071]:   <devices>
Nov 29 13:29:11 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:29:11 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:29:11 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk"/>
Nov 29 13:29:11 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:29:11 user nova-compute[75071]:     </disk>
Nov 29 13:29:11 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:29:11 user nova-compute[75071]:       <mac address="fa:16:3e:81:8f:99"/>
Nov 29 13:29:11 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:11 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:29:11 user nova-compute[75071]:       <target dev="tapb987d810-74"/>
Nov 29 13:29:11 user nova-compute[75071]:     </interface>
Nov 29 13:29:11 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:29:11 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/console.log" append="off"/>
Nov 29 13:29:11 user nova-compute[75071]:     </serial>
Nov 29 13:29:11 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:29:11 user nova-compute[75071]:     <video>
Nov 29 13:29:11 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:11 user nova-compute[75071]:     </video>
Nov 29 13:29:11 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:29:11 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:29:11 user nova-compute[75071]:     </rng>
Nov 29 13:29:11 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:29:11 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:29:11 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:29:11 user nova-compute[75071]:     </memballoon>
Nov 29 13:29:11 user nova-compute[75071]:   </devices>
Nov 29 13:29:11 user nova-compute[75071]: </domain>
Nov 29 13:29:11 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-539973920',display_name='tempest-AttachVolumeNegativeTest-server-539973920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-539973920',id=27,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGl7B5wdgCUgm3qV6w64Nu6upkQaZw8I6LFuugjANNqs3yTD00NMmol9gtkFdRO/DHR1+1hJeWsSLyhU57hhpFMJurYlL2dL9A0aibHrKp8nye0gZSy+BfqGi5DKChd/Q==',key_name='tempest-keypair-236222793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-lf7h021t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=daa8724e-64a5-462a-8958-ac034d0b6721,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8f:99,bridge_name='br-int',has_traffic_filtering=True,id=b987d810-7434-4a89-bcd5-7aa9cf6b7e35,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987d810-74') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG os_vif [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8f:99,bridge_name='br-int',has_traffic_filtering=True,id=b987d810-7434-4a89-bcd5-7aa9cf6b7e35,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987d810-74') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fad07a8-e443-5bdc-88e9-fac8dcf61cbf', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb987d810-74, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb987d810-74, col_values=(('qos', UUID('5f32bcf7-119e-4e86-bfd4-00ddd57636b7')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb987d810-74, col_values=(('external_ids', {'iface-id': 'b987d810-7434-4a89-bcd5-7aa9cf6b7e35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:8f:99', 'vm-uuid': 'daa8724e-64a5-462a-8958-ac034d0b6721'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:11 user nova-compute[75071]: INFO os_vif [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8f:99,bridge_name='br-int',has_traffic_filtering=True,id=b987d810-7434-4a89-bcd5-7aa9cf6b7e35,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987d810-74')
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No VIF found with MAC fa:16:3e:81:8f:99, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Updated VIF entry in instance network info cache for port b987d810-7434-4a89-bcd5-7aa9cf6b7e35. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Updating instance_info_cache with network_info: [{"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2f36723c-9a53-419a-8956-cc76ccf5559f req-4620b2ec-e592-4bf6-86f5-b3293a8fb44b service nova] Releasing lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 -F raw /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk" returned: 0 in 2.477s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Ensure instance console log exists: /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Start _get_guest_xml network_info=[{"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='9d4f4354949ed4757d994a9d09498ebb',container_format='bare',created_at=2023-11-29T13:27:04Z,direct_url=<?>,disk_format='qcow2',id=ec3e2055-27a0-4d2f-bf46-c5f170a4510a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1897835708-shelved',owner='c34bfa3e9f6b47beb18fb97da4bfb176',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T13:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkaSxiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '73c90d9c-3089-4d7b-9ac9-7c2105cd4649', 'attached_at': '', 'detached_at': '', 'volume_id': 'a934e1b5-90c2-413b-9e54-aa4e304d3944', 'serial': 'a934e1b5-90c2-413b-9e54-aa4e304d3944'}, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '05e28275-90a4-4cf4-b810-b1b3d5ec2cd9', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:29:12 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:12 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9d4f4354949ed4757d994a9d09498ebb',container_format='bare',created_at=2023-11-29T13:27:04Z,direct_url=<?>,disk_format='qcow2',id=ec3e2055-27a0-4d2f-bf46-c5f170a4510a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1897835708-shelved',owner='c34bfa3e9f6b47beb18fb97da4bfb176',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T13:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.objects.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<73c90d9c-3089-4d7b-9ac9-7c2105cd4649> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkaSxiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:29:12 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:12 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:12 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3525518-c739-43cd-b9f8-2182dc706cb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:29:12 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfdf333-e76a-45c3-8398-e794e7eb5fd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944] added
Nov 29 13:29:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31dcc6e-baa4-45ca-a4f3-8ab4c2425716]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b22930-6343-486c-a638-65735557b77f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXkaSxiT {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXkaSxiT" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40119ef9-0fc9-44cd-bc1b-fa52b8c08263]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXkaSxiT'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3c72b8-913c-440e-942d-9553f6340c88]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77de68af-1044-48a5-9d2c-9f59ee147b90]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3d4b2b-0748-42a6-8790-a0e2b75f7fc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260]
Nov 29 13:29:12 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260] successful.
Nov 29 13:29:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f947d38-c478-49dc-a71c-d0ce081b3d5f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8619f342-7557-49fe-a928-8a53969a8e55]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8482c3e-f45a-4571-9267-bfa661fab3ea]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkaSxiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:29:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d3916d8-39d7-4f16-8e23-78e05121acad req-9b050356-47da-4bcc-9e2f-0499e63c3220 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d3916d8-39d7-4f16-8e23-78e05121acad req-9b050356-47da-4bcc-9e2f-0499e63c3220 service nova] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d3916d8-39d7-4f16-8e23-78e05121acad req-9b050356-47da-4bcc-9e2f-0499e63c3220 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d3916d8-39d7-4f16-8e23-78e05121acad req-9b050356-47da-4bcc-9e2f-0499e63c3220 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d3916d8-39d7-4f16-8e23-78e05121acad req-9b050356-47da-4bcc-9e2f-0499e63c3220 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] No waiting events found dispatching network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:13 user nova-compute[75071]: WARNING nova.compute.manager [req-2d3916d8-39d7-4f16-8e23-78e05121acad req-9b050356-47da-4bcc-9e2f-0499e63c3220 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received unexpected event network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 for instance with vm_state building and task_state spawning.
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26665653733386331', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665653733386331', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1897835708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1897835708',id=20,image_ref='ec3e2055-27a0-4d2f-bf46-c5f170a4510a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-973435994',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-3z5pz8a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member',shelved_at='2023-11-29T13:27:08.353453',shelved_host='user',shelved_image_id='ec3e2055-27a0-4d2f-bf46-c5f170a4510a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:28:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=73c90d9c-3089-4d7b-9ac9-7c2105cd4649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'pci_devices' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.objects.base [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<73c90d9c-3089-4d7b-9ac9-7c2105cd4649> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:29:13 user nova-compute[75071]:   <uuid>73c90d9c-3089-4d7b-9ac9-7c2105cd4649</uuid>
Nov 29 13:29:13 user nova-compute[75071]:   <name>instance-00000014</name>
Nov 29 13:29:13 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:29:13 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:29:13 user nova-compute[75071]:   <metadata>
Nov 29 13:29:13 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:29:13 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:29:13 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1897835708</nova:name>
Nov 29 13:29:13 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:29:12</nova:creationTime>
Nov 29 13:29:13 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:29:13 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:29:13 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:29:13 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:29:13 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:29:13 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:29:13 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:29:13 user nova-compute[75071]:       <nova:owner>
Nov 29 13:29:13 user nova-compute[75071]:         <nova:user uuid="013770deb90c4a83a4a822afdc45a2b9">tempest-AttachVolumeShelveTestJSON-2031472443-project-member</nova:user>
Nov 29 13:29:13 user nova-compute[75071]:         <nova:project uuid="c34bfa3e9f6b47beb18fb97da4bfb176">tempest-AttachVolumeShelveTestJSON-2031472443</nova:project>
Nov 29 13:29:13 user nova-compute[75071]:       </nova:owner>
Nov 29 13:29:13 user nova-compute[75071]:       <nova:root type="image" uuid="ec3e2055-27a0-4d2f-bf46-c5f170a4510a"/>
Nov 29 13:29:13 user nova-compute[75071]:       <nova:ports>
Nov 29 13:29:13 user nova-compute[75071]:         <nova:port uuid="8b97467c-89dd-4ec6-b403-1dcee24246e1">
Nov 29 13:29:13 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:29:13 user nova-compute[75071]:         </nova:port>
Nov 29 13:29:13 user nova-compute[75071]:       </nova:ports>
Nov 29 13:29:13 user nova-compute[75071]:     </nova:instance>
Nov 29 13:29:13 user nova-compute[75071]:   </metadata>
Nov 29 13:29:13 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:29:13 user nova-compute[75071]:     <system>
Nov 29 13:29:13 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:29:13 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:29:13 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:29:13 user nova-compute[75071]:       <entry name="serial">73c90d9c-3089-4d7b-9ac9-7c2105cd4649</entry>
Nov 29 13:29:13 user nova-compute[75071]:       <entry name="uuid">73c90d9c-3089-4d7b-9ac9-7c2105cd4649</entry>
Nov 29 13:29:13 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:29:13 user nova-compute[75071]:     </system>
Nov 29 13:29:13 user nova-compute[75071]:   </sysinfo>
Nov 29 13:29:13 user nova-compute[75071]:   <os>
Nov 29 13:29:13 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:29:13 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:29:13 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:29:13 user nova-compute[75071]:   </os>
Nov 29 13:29:13 user nova-compute[75071]:   <features>
Nov 29 13:29:13 user nova-compute[75071]:     <acpi/>
Nov 29 13:29:13 user nova-compute[75071]:     <apic/>
Nov 29 13:29:13 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:29:13 user nova-compute[75071]:   </features>
Nov 29 13:29:13 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:29:13 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:29:13 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:29:13 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:29:13 user nova-compute[75071]:   </clock>
Nov 29 13:29:13 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:29:13 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:29:13 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:29:13 user nova-compute[75071]:   </cpu>
Nov 29 13:29:13 user nova-compute[75071]:   <devices>
Nov 29 13:29:13 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:29:13 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:29:13 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk"/>
Nov 29 13:29:13 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:29:13 user nova-compute[75071]:     </disk>
Nov 29 13:29:13 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:29:13 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:29:13 user nova-compute[75071]:       <source dev="/dev/sdf"/>
Nov 29 13:29:13 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Nov 29 13:29:13 user nova-compute[75071]:       <serial>a934e1b5-90c2-413b-9e54-aa4e304d3944</serial>
Nov 29 13:29:13 user nova-compute[75071]:     </disk>
Nov 29 13:29:13 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:29:13 user nova-compute[75071]:       <mac address="fa:16:3e:01:d1:6a"/>
Nov 29 13:29:13 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:13 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:29:13 user nova-compute[75071]:       <target dev="tap8b97467c-89"/>
Nov 29 13:29:13 user nova-compute[75071]:     </interface>
Nov 29 13:29:13 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:29:13 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/console.log" append="off"/>
Nov 29 13:29:13 user nova-compute[75071]:     </serial>
Nov 29 13:29:13 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:29:13 user nova-compute[75071]:     <video>
Nov 29 13:29:13 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:13 user nova-compute[75071]:     </video>
Nov 29 13:29:13 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:29:13 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:29:13 user nova-compute[75071]:     </rng>
Nov 29 13:29:13 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:29:13 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:29:13 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:29:13 user nova-compute[75071]:     </memballoon>
Nov 29 13:29:13 user nova-compute[75071]:   </devices>
Nov 29 13:29:13 user nova-compute[75071]: </domain>
Nov 29 13:29:13 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1897835708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1897835708',id=20,image_ref='ec3e2055-27a0-4d2f-bf46-c5f170a4510a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-973435994',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:25:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-3z5pz8a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member',shelved_at='2023-11-29T13:27:08.353453',shelved_host='user',shelved_image_id='ec3e2055-27a0-4d2f-bf46-c5f170a4510a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:28:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=73c90d9c-3089-4d7b-9ac9-7c2105cd4649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG os_vif [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '903d34f8-59da-587a-ad29-ab0dfb3aeb6d', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b97467c-89, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b97467c-89, col_values=(('qos', UUID('91a0f6e9-e03e-48ba-929c-ccc82ded95ac')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b97467c-89, col_values=(('external_ids', {'iface-id': '8b97467c-89dd-4ec6-b403-1dcee24246e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:d1:6a', 'vm-uuid': '73c90d9c-3089-4d7b-9ac9-7c2105cd4649'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:13 user nova-compute[75071]: INFO os_vif [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89')
Nov 29 13:29:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:29:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:29:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No VIF found with MAC fa:16:3e:01:d1:6a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:29:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Instance spawned successfully.
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-a6848c92-82ae-4a72-aabd-2a59f518cfb8 req-1b9bef0d-766b-49be-bdad-d8deef7c4b07 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a6848c92-82ae-4a72-aabd-2a59f518cfb8 req-1b9bef0d-766b-49be-bdad-d8deef7c4b07 service nova] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a6848c92-82ae-4a72-aabd-2a59f518cfb8 req-1b9bef0d-766b-49be-bdad-d8deef7c4b07 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a6848c92-82ae-4a72-aabd-2a59f518cfb8 req-1b9bef0d-766b-49be-bdad-d8deef7c4b07 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-a6848c92-82ae-4a72-aabd-2a59f518cfb8 req-1b9bef0d-766b-49be-bdad-d8deef7c4b07 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] No waiting events found dispatching network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:15 user nova-compute[75071]: WARNING nova.compute.manager [req-a6848c92-82ae-4a72-aabd-2a59f518cfb8 req-1b9bef0d-766b-49be-bdad-d8deef7c4b07 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received unexpected event network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 for instance with vm_state building and task_state spawning.
Nov 29 13:29:15 user nova-compute[75071]: INFO nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 29 13:29:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:15 user nova-compute[75071]: INFO nova.compute.manager [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Took 7.92 seconds to build instance.
Nov 29 13:29:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e66c3169-ed66-45e0-962e-eeb825e5172a tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.046s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:17 user nova-compute[75071]: WARNING nova.compute.manager [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received unexpected event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 13:29:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:17 user nova-compute[75071]: WARNING nova.compute.manager [req-9db817e1-b728-4b58-9398-0ceeeca32a89 req-9909a204-db71-4b2c-b8fc-615402565952 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received unexpected event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 13:29:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:29:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:29:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance spawned successfully.
Nov 29 13:29:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b7bd0718-bb10-401a-b393-f7ad3cc845c4 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.177s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-9404b196-3c09-4c3b-a7df-46b14916b373 req-2becd47a-1089-488e-a32e-95346f41c197 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event volume-reimaged-45b95d97-ae9c-4e05-8ec4-7856a367f9b1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9404b196-3c09-4c3b-a7df-46b14916b373 req-2becd47a-1089-488e-a32e-95346f41c197 service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9404b196-3c09-4c3b-a7df-46b14916b373 req-2becd47a-1089-488e-a32e-95346f41c197 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9404b196-3c09-4c3b-a7df-46b14916b373 req-2becd47a-1089-488e-a32e-95346f41c197 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-9404b196-3c09-4c3b-a7df-46b14916b373 req-2becd47a-1089-488e-a32e-95346f41c197 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Processing event volume-reimaged-45b95d97-ae9c-4e05-8ec4-7856a367f9b1 {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:18 user nova-compute[75071]: INFO nova.virt.block_device [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Booting with volume 45b95d97-ae9c-4e05-8ec4-7856a367f9b1 at /dev/vda
Nov 29 13:29:18 user nova-compute[75071]: DEBUG os_brick.utils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2194409-a314-4681-af87-88e0d9bf7bb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4562ff1-c174-43d6-81a3-7416dd28b218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c877323f-ae03-4124-baea-f3677486a90b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c9f1c4-bdc5-4e54-a9e0-303a5fe3ffe5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:29:18 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:29:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15408bc5-b8ce-4c92-90cb-87639c73b8b0]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG os_brick.utils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updating existing volume attachment record: 43b40fdf-3b10-429d-9901-aa3ffb0390a1 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:29:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:29:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:29:25 user nova-compute[75071]: INFO nova.compute.claims [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Claim successful on node user
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:29:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:29:26 user nova-compute[75071]: INFO nova.virt.block_device [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Booting with volume 3604afe3-29c9-401a-ac33-2cdb4841849d at /dev/vda
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.policy [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8395b32f70af4fd782ad81a609e9f63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f5f5e7553949989e7fc90db828a0bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG os_brick.utils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0a29ac-24fc-495b-b65c-d567eebdb96f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d51933-2ae1-41ec-805f-bbac53f0d98e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78186c80-faf6-4995-8cc0-86a76f794f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a841816b-a172-404f-951e-dbb23e1ed5fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:29:26 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:29:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b48e5bc-6939-493f-9edf-576282a797a6]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG os_brick.utils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:29:26 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating existing volume attachment record: f6f4619a-57ae-4bef-b8ae-3ed92b3aeae5 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Successfully created port: 4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:29:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Creating image(s)
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Ensure instance console log exists: /opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Start _get_guest_xml network_info=[{"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '003e4c80-34c6-4c05-a9a7-9da023b7bc0e', 'attached_at': '', 'detached_at': '', 'volume_id': '45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'serial': '45b95d97-ae9c-4e05-8ec4-7856a367f9b1'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '43b40fdf-3b10-429d-9901-aa3ffb0390a1', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:29:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 13:29:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lazy-loading 'vcpu_model' on Instance uuid 003e4c80-34c6-4c05-a9a7-9da023b7bc0e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:29:27 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:27 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:27 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a89d2a-f606-4e53-b522-38a9c9a04e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:29:27 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a11ce60-5006-449e-9f2d-613c06f94d68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1] added
Nov 29 13:29:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a76667-dfdd-4679-8c95-90469a665442]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e866b0-20e5-4267-a4d2-7e29a35ab4dc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIlVgBcU {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIlVgBcU" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761023b-760a-4cf1-9872-cc826d6c8da9]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIlVgBcU'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f250aac-b73f-4f1b-9c47-fb0a893968cf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc752d3-e990-47de-8f02-2fc302d452b4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Successfully updated port: 4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[613d59ef-6858-4a08-9767-b3c8d1c87562]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]
Nov 29 13:29:27 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.
Nov 29 13:29:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquired lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc3ac3-42a0-4b3c-87a0-0e235c9beda1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-changed-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Refreshing instance network info cache due to event network-changed-4bf27380-50d5-48e1-bf2d-4bd5cc33020c. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] Acquiring lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dffcb1b-118f-49b0-9ebc-15c76f492c90]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ba191-72b0-4843-b00c-d3a4676fcdb5]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:29:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Releasing lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance network_info: |[{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] Acquired lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Refreshing network info cache for port 4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updated VIF entry in instance network info cache for port 4bf27380-50d5-48e1-bf2d-4bd5cc33020c. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b6841025-6fe0-4633-bab7-e57c2b306350 req-356f5627-c8ca-4432-8081-d6dfd1c40c84 service nova] Releasing lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26138396437643130', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138396437643130', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-172562232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2077791717',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfBnNA+l6YYtmYNkSg1+7s0Ze1ddryiQfXZLhNcjqMSj8oc5W03kR1glk/dkK9+JrmXvGkDbgD54809kDz8qwdonFyg6AQ17M2qJSInHDXXwV1R8WVChhaoXbQGyjkmag==',key_name='tempest-keypair-1963758755',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:27:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a5dedba01ce4e37a5b067def2eaea80',ramdisk_id='',reservation_id='r-25i14ftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1240456810',owner_user_name='tempest-ServerActionsV293TestJSON-1240456810-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6af3003b85a4cc281a9d2bbb9465fdb',uuid=003e4c80-34c6-4c05-a9a7-9da023b7bc0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converting VIF {"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:29:29 user nova-compute[75071]:   <uuid>003e4c80-34c6-4c05-a9a7-9da023b7bc0e</uuid>
Nov 29 13:29:29 user nova-compute[75071]:   <name>instance-00000018</name>
Nov 29 13:29:29 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:29:29 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:29:29 user nova-compute[75071]:   <metadata>
Nov 29 13:29:29 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:29:29 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:29:29 user nova-compute[75071]:       <nova:name>tempest-ServerActionsV293TestJSON-server-172562232</nova:name>
Nov 29 13:29:29 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:29:27</nova:creationTime>
Nov 29 13:29:29 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:29:29 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:29:29 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:29:29 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:29:29 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:29:29 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:29:29 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:29:29 user nova-compute[75071]:       <nova:owner>
Nov 29 13:29:29 user nova-compute[75071]:         <nova:user uuid="e6af3003b85a4cc281a9d2bbb9465fdb">tempest-ServerActionsV293TestJSON-1240456810-project-member</nova:user>
Nov 29 13:29:29 user nova-compute[75071]:         <nova:project uuid="8a5dedba01ce4e37a5b067def2eaea80">tempest-ServerActionsV293TestJSON-1240456810</nova:project>
Nov 29 13:29:29 user nova-compute[75071]:       </nova:owner>
Nov 29 13:29:29 user nova-compute[75071]:       <nova:ports>
Nov 29 13:29:29 user nova-compute[75071]:         <nova:port uuid="3b3aaef8-787e-4dcb-aa02-987d3920cb65">
Nov 29 13:29:29 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:29:29 user nova-compute[75071]:         </nova:port>
Nov 29 13:29:29 user nova-compute[75071]:       </nova:ports>
Nov 29 13:29:29 user nova-compute[75071]:     </nova:instance>
Nov 29 13:29:29 user nova-compute[75071]:   </metadata>
Nov 29 13:29:29 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:29:29 user nova-compute[75071]:     <system>
Nov 29 13:29:29 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:29:29 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:29:29 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:29:29 user nova-compute[75071]:       <entry name="serial">003e4c80-34c6-4c05-a9a7-9da023b7bc0e</entry>
Nov 29 13:29:29 user nova-compute[75071]:       <entry name="uuid">003e4c80-34c6-4c05-a9a7-9da023b7bc0e</entry>
Nov 29 13:29:29 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:29:29 user nova-compute[75071]:     </system>
Nov 29 13:29:29 user nova-compute[75071]:   </sysinfo>
Nov 29 13:29:29 user nova-compute[75071]:   <os>
Nov 29 13:29:29 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:29:29 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:29:29 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:29:29 user nova-compute[75071]:   </os>
Nov 29 13:29:29 user nova-compute[75071]:   <features>
Nov 29 13:29:29 user nova-compute[75071]:     <acpi/>
Nov 29 13:29:29 user nova-compute[75071]:     <apic/>
Nov 29 13:29:29 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:29:29 user nova-compute[75071]:   </features>
Nov 29 13:29:29 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:29:29 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:29:29 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:29:29 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:29:29 user nova-compute[75071]:   </clock>
Nov 29 13:29:29 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:29:29 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:29:29 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:29:29 user nova-compute[75071]:   </cpu>
Nov 29 13:29:29 user nova-compute[75071]:   <devices>
Nov 29 13:29:29 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:29:29 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:29:29 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Nov 29 13:29:29 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:29:29 user nova-compute[75071]:       <serial>45b95d97-ae9c-4e05-8ec4-7856a367f9b1</serial>
Nov 29 13:29:29 user nova-compute[75071]:     </disk>
Nov 29 13:29:29 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:29:29 user nova-compute[75071]:       <mac address="fa:16:3e:6d:32:0d"/>
Nov 29 13:29:29 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:29 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:29:29 user nova-compute[75071]:       <target dev="tap3b3aaef8-78"/>
Nov 29 13:29:29 user nova-compute[75071]:     </interface>
Nov 29 13:29:29 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:29:29 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e/console.log" append="off"/>
Nov 29 13:29:29 user nova-compute[75071]:     </serial>
Nov 29 13:29:29 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:29:29 user nova-compute[75071]:     <video>
Nov 29 13:29:29 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:29 user nova-compute[75071]:     </video>
Nov 29 13:29:29 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:29:29 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:29:29 user nova-compute[75071]:     </rng>
Nov 29 13:29:29 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:29:29 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:29:29 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:29:29 user nova-compute[75071]:     </memballoon>
Nov 29 13:29:29 user nova-compute[75071]:   </devices>
Nov 29 13:29:29 user nova-compute[75071]: </domain>
Nov 29 13:29:29 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-172562232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2077791717',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfBnNA+l6YYtmYNkSg1+7s0Ze1ddryiQfXZLhNcjqMSj8oc5W03kR1glk/dkK9+JrmXvGkDbgD54809kDz8qwdonFyg6AQ17M2qJSInHDXXwV1R8WVChhaoXbQGyjkmag==',key_name='tempest-keypair-1963758755',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:27:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a5dedba01ce4e37a5b067def2eaea80',ramdisk_id='',reservation_id='r-25i14ftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1240456810',owner_user_name='tempest-ServerActionsV293TestJSON-1240456810-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6af3003b85a4cc281a9d2bbb9465fdb',uuid=003e4c80-34c6-4c05-a9a7-9da023b7bc0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converting VIF {"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG os_vif [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '146fcc45-1791-5968-a398-210ea77999c1', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b3aaef8-78, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b3aaef8-78, col_values=(('qos', UUID('d4ba25d1-f559-4825-b6d5-b9c07c04ea2c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b3aaef8-78, col_values=(('external_ids', {'iface-id': '3b3aaef8-787e-4dcb-aa02-987d3920cb65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:32:0d', 'vm-uuid': '003e4c80-34c6-4c05-a9a7-9da023b7bc0e'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:29 user nova-compute[75071]: INFO os_vif [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78')
Nov 29 13:29:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:29:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] No VIF found with MAC fa:16:3e:6d:32:0d, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-677bbc19-f1d4-49ce-a059-d8125c217681 req-69730097-5cbc-4001-a5dd-904b99b911c9 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-677bbc19-f1d4-49ce-a059-d8125c217681 req-69730097-5cbc-4001-a5dd-904b99b911c9 service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-677bbc19-f1d4-49ce-a059-d8125c217681 req-69730097-5cbc-4001-a5dd-904b99b911c9 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-677bbc19-f1d4-49ce-a059-d8125c217681 req-69730097-5cbc-4001-a5dd-904b99b911c9 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-677bbc19-f1d4-49ce-a059-d8125c217681 req-69730097-5cbc-4001-a5dd-904b99b911c9 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:30 user nova-compute[75071]: WARNING nova.compute.manager [req-677bbc19-f1d4-49ce-a059-d8125c217681 req-69730097-5cbc-4001-a5dd-904b99b911c9 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received unexpected event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 13:29:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-bcc0dc44-71b3-4c53-8d11-5e900d273111 req-5da8d4eb-3194-4c10-ae16-fb9a90252e9c service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bcc0dc44-71b3-4c53-8d11-5e900d273111 req-5da8d4eb-3194-4c10-ae16-fb9a90252e9c service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bcc0dc44-71b3-4c53-8d11-5e900d273111 req-5da8d4eb-3194-4c10-ae16-fb9a90252e9c service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bcc0dc44-71b3-4c53-8d11-5e900d273111 req-5da8d4eb-3194-4c10-ae16-fb9a90252e9c service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-bcc0dc44-71b3-4c53-8d11-5e900d273111 req-5da8d4eb-3194-4c10-ae16-fb9a90252e9c service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:32 user nova-compute[75071]: WARNING nova.compute.manager [req-bcc0dc44-71b3-4c53-8d11-5e900d273111 req-5da8d4eb-3194-4c10-ae16-fb9a90252e9c service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received unexpected event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:29:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance spawned successfully.
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:29:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75071) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 13:29:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9404b196-3c09-4c3b-a7df-46b14916b373 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:29:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Creating image(s)
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Ensure instance console log exists: /opt/stack/data/nova/instances/08de871b-9fc3-4766-b32a-01d809a2d4c1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Start _get_guest_xml network_info=[{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08de871b-9fc3-4766-b32a-01d809a2d4c1', 'attached_at': '', 'detached_at': '', 'volume_id': '3604afe3-29c9-401a-ac33-2cdb4841849d', 'serial': '3604afe3-29c9-401a-ac33-2cdb4841849d'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'f6f4619a-57ae-4bef-b8ae-3ed92b3aeae5', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:29:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:29:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:35 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[433aa7dd-9595-4140-9ef8-24825f7f1a64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:29:35 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191c0b3-fa21-4d48-a09c-4f509a215591]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d] added
Nov 29 13:29:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da85b029-382d-48ce-ba3f-30b172e75f69]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f300e80-d033-4e60-bbe0-0ae49575efe8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgnjvOrc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgnjvOrc" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5efd00a-1dd4-4355-a029-b355c42cc827]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BgnjvOrc'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1aaf83-c190-4137-ae50-42d763fd62f8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafcd1df-4bf3-4eb6-a42d-868c8fe24f1c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23691290-de54-4a2a-bc5e-948b6521051a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]
Nov 29 13:29:35 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.
Nov 29 13:29:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c37ba0f-6506-46c1-aee9-a07cc49c8efa]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e29398-b7fd-452f-b95b-f875d5db93a1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:29:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:35 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:29:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0f672-8d94-4d25-a185-648fc1498284]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23863353038613862', 'path': '/dev/sdg'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863353038613862', 'path': '/dev/sdg'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-553239605',display_name='tempest-ServerActionsTestOtherA-server-553239605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-553239605',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-8xt3hjum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=08de871b-9fc3-4766-b32a-01d809a2d4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'pci_devices' on Instance uuid 08de871b-9fc3-4766-b32a-01d809a2d4c1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:29:36 user nova-compute[75071]:   <uuid>08de871b-9fc3-4766-b32a-01d809a2d4c1</uuid>
Nov 29 13:29:36 user nova-compute[75071]:   <name>instance-0000001c</name>
Nov 29 13:29:36 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:29:36 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:29:36 user nova-compute[75071]:   <metadata>
Nov 29 13:29:36 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:29:36 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:29:36 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-553239605</nova:name>
Nov 29 13:29:36 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:29:35</nova:creationTime>
Nov 29 13:29:36 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:29:36 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:29:36 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:29:36 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:29:36 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:29:36 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:29:36 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:29:36 user nova-compute[75071]:       <nova:owner>
Nov 29 13:29:36 user nova-compute[75071]:         <nova:user uuid="8395b32f70af4fd782ad81a609e9f63a">tempest-ServerActionsTestOtherA-611751521-project-member</nova:user>
Nov 29 13:29:36 user nova-compute[75071]:         <nova:project uuid="36f5f5e7553949989e7fc90db828a0bd">tempest-ServerActionsTestOtherA-611751521</nova:project>
Nov 29 13:29:36 user nova-compute[75071]:       </nova:owner>
Nov 29 13:29:36 user nova-compute[75071]:       <nova:ports>
Nov 29 13:29:36 user nova-compute[75071]:         <nova:port uuid="4bf27380-50d5-48e1-bf2d-4bd5cc33020c">
Nov 29 13:29:36 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:29:36 user nova-compute[75071]:         </nova:port>
Nov 29 13:29:36 user nova-compute[75071]:       </nova:ports>
Nov 29 13:29:36 user nova-compute[75071]:     </nova:instance>
Nov 29 13:29:36 user nova-compute[75071]:   </metadata>
Nov 29 13:29:36 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:29:36 user nova-compute[75071]:     <system>
Nov 29 13:29:36 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:29:36 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:29:36 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:29:36 user nova-compute[75071]:       <entry name="serial">08de871b-9fc3-4766-b32a-01d809a2d4c1</entry>
Nov 29 13:29:36 user nova-compute[75071]:       <entry name="uuid">08de871b-9fc3-4766-b32a-01d809a2d4c1</entry>
Nov 29 13:29:36 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:29:36 user nova-compute[75071]:     </system>
Nov 29 13:29:36 user nova-compute[75071]:   </sysinfo>
Nov 29 13:29:36 user nova-compute[75071]:   <os>
Nov 29 13:29:36 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:29:36 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:29:36 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:29:36 user nova-compute[75071]:   </os>
Nov 29 13:29:36 user nova-compute[75071]:   <features>
Nov 29 13:29:36 user nova-compute[75071]:     <acpi/>
Nov 29 13:29:36 user nova-compute[75071]:     <apic/>
Nov 29 13:29:36 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:29:36 user nova-compute[75071]:   </features>
Nov 29 13:29:36 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:29:36 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:29:36 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:29:36 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:29:36 user nova-compute[75071]:   </clock>
Nov 29 13:29:36 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:29:36 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:29:36 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:29:36 user nova-compute[75071]:   </cpu>
Nov 29 13:29:36 user nova-compute[75071]:   <devices>
Nov 29 13:29:36 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:29:36 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:29:36 user nova-compute[75071]:       <source dev="/dev/sdg"/>
Nov 29 13:29:36 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:29:36 user nova-compute[75071]:       <serial>3604afe3-29c9-401a-ac33-2cdb4841849d</serial>
Nov 29 13:29:36 user nova-compute[75071]:     </disk>
Nov 29 13:29:36 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:29:36 user nova-compute[75071]:       <mac address="fa:16:3e:c7:ca:fe"/>
Nov 29 13:29:36 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:36 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:29:36 user nova-compute[75071]:       <target dev="tap4bf27380-50"/>
Nov 29 13:29:36 user nova-compute[75071]:     </interface>
Nov 29 13:29:36 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:29:36 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/08de871b-9fc3-4766-b32a-01d809a2d4c1/console.log" append="off"/>
Nov 29 13:29:36 user nova-compute[75071]:     </serial>
Nov 29 13:29:36 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:29:36 user nova-compute[75071]:     <video>
Nov 29 13:29:36 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:29:36 user nova-compute[75071]:     </video>
Nov 29 13:29:36 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:29:36 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:29:36 user nova-compute[75071]:     </rng>
Nov 29 13:29:36 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:29:36 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:29:36 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:29:36 user nova-compute[75071]:     </memballoon>
Nov 29 13:29:36 user nova-compute[75071]:   </devices>
Nov 29 13:29:36 user nova-compute[75071]: </domain>
Nov 29 13:29:36 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-553239605',display_name='tempest-ServerActionsTestOtherA-server-553239605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-553239605',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-8xt3hjum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=08de871b-9fc3-4766-b32a-01d809a2d4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG os_vif [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4216f730-05a2-5892-8a9a-f402a137eccb', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bf27380-50, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bf27380-50, col_values=(('qos', UUID('d5f2c428-ce8c-431d-9de8-f18772065000')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bf27380-50, col_values=(('external_ids', {'iface-id': '4bf27380-50d5-48e1-bf2d-4bd5cc33020c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:ca:fe', 'vm-uuid': '08de871b-9fc3-4766-b32a-01d809a2d4c1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:36 user nova-compute[75071]: INFO os_vif [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50')
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No VIF found with MAC fa:16:3e:c7:ca:fe, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:29:36 user nova-compute[75071]: INFO nova.compute.manager [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Unrescuing
Nov 29 13:29:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating instance_info_cache with network_info: [{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'flavor' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-e87783bc-63bb-4ac8-853b-ce6fa4d18bd1 req-7beffea5-54e8-4ae8-bfcc-ae415c242bc3 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e87783bc-63bb-4ac8-853b-ce6fa4d18bd1 req-7beffea5-54e8-4ae8-bfcc-ae415c242bc3 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e87783bc-63bb-4ac8-853b-ce6fa4d18bd1 req-7beffea5-54e8-4ae8-bfcc-ae415c242bc3 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e87783bc-63bb-4ac8-853b-ce6fa4d18bd1 req-7beffea5-54e8-4ae8-bfcc-ae415c242bc3 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-e87783bc-63bb-4ac8-853b-ce6fa4d18bd1 req-7beffea5-54e8-4ae8-bfcc-ae415c242bc3 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:37 user nova-compute[75071]: WARNING nova.compute.manager [req-e87783bc-63bb-4ac8-853b-ce6fa4d18bd1 req-7beffea5-54e8-4ae8-bfcc-ae415c242bc3 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:29:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance destroyed successfully.
Nov 29 13:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:39 user nova-compute[75071]: WARNING nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:39 user nova-compute[75071]: WARNING nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state building and task_state spawning.
Nov 29 13:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:39 user nova-compute[75071]: WARNING nova.compute.manager [req-5fe16c3d-16a3-4e15-bcbb-d0a446192b79 req-c8324f6d-73a3-4726-b573-435acb56c710 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state building and task_state spawning.
Nov 29 13:29:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:29:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance spawned successfully.
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:41 user nova-compute[75071]: INFO nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:41 user nova-compute[75071]: WARNING nova.compute.manager [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:41 user nova-compute[75071]: WARNING nova.compute.manager [req-de4a2eed-f1ea-4189-81f0-ccf1966b8379 req-579104e1-e39a-4fc6-bd7e-4d67cb2b3805 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:29:41 user nova-compute[75071]: INFO nova.compute.manager [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Took 16.23 seconds to build instance.
Nov 29 13:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bc7ba075-e73b-4b41-873c-611824842117 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.361s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-changed-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Refreshing instance network info cache due to event network-changed-2a2c6093-ffca-45b4-95f9-b612afba26a5. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] Acquiring lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] Acquired lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Refreshing network info cache for port 2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:29:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c930ac01-8e15-4249-bcb3-93b6b6e996b5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:29:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updated VIF entry in instance network info cache for port 2a2c6093-ffca-45b4-95f9-b612afba26a5. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:29:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating instance_info_cache with network_info: [{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2932da69-6b76-42f1-b032-db2d3f910514 req-d517e055-8e66-45f8-862f-3ba03d96ab57 service nova] Releasing lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:45 user nova-compute[75071]: INFO nova.compute.manager [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Attaching volume f4b7c2d2-4b60-460b-902c-706d82921a39 to /dev/vdb
Nov 29 13:29:45 user nova-compute[75071]: DEBUG os_brick.utils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d717c82-8793-4a3d-9edd-c457cb38f2bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55db63-e212-44a2-9142-f0cd0e43b957]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b565b9-b480-4630-a298-475740b61cc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa89e94-3b71-4b88-bd31-3f49da8a4f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:29:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:29:46 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:29:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505dde7-4533-4c25-b6da-f8ced046a444]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:29:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:29:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:29:46 user nova-compute[75071]: DEBUG os_brick.utils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:29:46 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating existing volume attachment record: 1fad5cad-3931-4d2b-ac1e-a3956dd8d9ac {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:29:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.05121612548828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0c6a1702-5e65-4648-915d-2186ca6fc54c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 003e4c80-34c6-4c05-a9a7-9da023b7bc0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance daa8724e-64a5-462a-8958-ac034d0b6721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:29:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:29:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 64806dd7-0adb-4bb2-954a-707928115ce9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BGkOXpse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:29:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:29:55 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45bb1c9-d8a6-405c-a437-23c0e3faed13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:29:55 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7847990-a741-46fd-9891-c43ed495ea74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39] added
Nov 29 13:29:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5a93fd-74ac-44c9-aead-f913b5744e1a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d05cc87-05a2-4f33-8fd0-697c3feea58e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BGkOXpse {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BGkOXpse" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bcd093-baec-4dab-9955-c1c7ef147510]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BGkOXpse'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acd3c86-fb8c-4604-80ec-37989e6cca8c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf3b98-b8eb-4d8e-a843-e177955d1444]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:29:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:29:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[125b1545-cf68-4f5c-8fdd-4512911da225]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]
Nov 29 13:29:55 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.
Nov 29 13:29:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bdd1b8-7df2-404b-9a29-5a64c418926b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4902fc2a-b459-439f-a31b-3d98491e23da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:29:55 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:29:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2863f9-292d-42f9-aca5-991622de2bd6]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BGkOXpse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:29:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26534663766306438', 'path': '/dev/sdh'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534663766306438', 'path': '/dev/sdh'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:29:56 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:29:56 user nova-compute[75071]:   <source dev="/dev/sdh"/>
Nov 29 13:29:56 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:29:56 user nova-compute[75071]:   <serial>f4b7c2d2-4b60-460b-902c-706d82921a39</serial>
Nov 29 13:29:56 user nova-compute[75071]: </disk>
Nov 29 13:29:56 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:29:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No VIF found with MAC fa:16:3e:a4:e6:92, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:29:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6e340c2f-55ca-49c7-83cb-50c0a3952eea tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.321s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56b6927-f004-4d58-9fd6-606b87242fcc tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56b6927-f004-4d58-9fd6-606b87242fcc tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56b6927-f004-4d58-9fd6-606b87242fcc tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56b6927-f004-4d58-9fd6-606b87242fcc tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75071) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c56b6927-f004-4d58-9fd6-606b87242fcc tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-b6229db5-4ba6-405d-844b-3e0bf42bd012 req-c558cae8-0f5f-4c98-bd91-b3afceeafab7 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b6229db5-4ba6-405d-844b-3e0bf42bd012 req-c558cae8-0f5f-4c98-bd91-b3afceeafab7 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b6229db5-4ba6-405d-844b-3e0bf42bd012 req-c558cae8-0f5f-4c98-bd91-b3afceeafab7 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b6229db5-4ba6-405d-844b-3e0bf42bd012 req-c558cae8-0f5f-4c98-bd91-b3afceeafab7 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-b6229db5-4ba6-405d-844b-3e0bf42bd012 req-c558cae8-0f5f-4c98-bd91-b3afceeafab7 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:29:58 user nova-compute[75071]: WARNING nova.compute.manager [req-b6229db5-4ba6-405d-844b-3e0bf42bd012 req-c558cae8-0f5f-4c98-bd91-b3afceeafab7 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state active and task_state powering-off.
Nov 29 13:29:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:29:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance destroyed successfully.
Nov 29 13:29:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56b6927-f004-4d58-9fd6-606b87242fcc tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56b6927-f004-4d58-9fd6-606b87242fcc tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.255s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-7ef62753-6664-4d54-a14e-5e6fa273d6c2 req-36e5eb5e-05f9-4955-b2db-91ddda388a3e service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7ef62753-6664-4d54-a14e-5e6fa273d6c2 req-36e5eb5e-05f9-4955-b2db-91ddda388a3e service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7ef62753-6664-4d54-a14e-5e6fa273d6c2 req-36e5eb5e-05f9-4955-b2db-91ddda388a3e service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7ef62753-6664-4d54-a14e-5e6fa273d6c2 req-36e5eb5e-05f9-4955-b2db-91ddda388a3e service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-7ef62753-6664-4d54-a14e-5e6fa273d6c2 req-36e5eb5e-05f9-4955-b2db-91ddda388a3e service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:30:00 user nova-compute[75071]: WARNING nova.compute.manager [req-7ef62753-6664-4d54-a14e-5e6fa273d6c2 req-36e5eb5e-05f9-4955-b2db-91ddda388a3e service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state None.
Nov 29 13:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing instance network info cache due to event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:30:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] Acquiring lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:30:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] Acquired lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:30:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:30:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updated VIF entry in instance network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:30:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f8510442-6621-4abc-83c1-21cac9c4188f req-1cf13c76-8274-4ced-93f4-9810af603b34 service nova] Releasing lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:30:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:10 user nova-compute[75071]: INFO nova.compute.manager [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Detaching volume b38a3474-54a6-46f6-9bca-550ec014db37
Nov 29 13:30:10 user nova-compute[75071]: INFO nova.virt.block_device [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Attempting to driver detach volume b38a3474-54a6-46f6-9bca-550ec014db37 from mountpoint /dev/vdb
Nov 29 13:30:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Attempting to detach device vdb from instance 0c6a1702-5e65-4648-915d-2186ca6fc54c from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:30:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:30:10 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:30:10 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:30:10 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:30:10 user nova-compute[75071]:   <serial>b38a3474-54a6-46f6-9bca-550ec014db37</serial>
Nov 29 13:30:10 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:30:10 user nova-compute[75071]: </disk>
Nov 29 13:30:10 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:30:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully detached device vdb from instance 0c6a1702-5e65-4648-915d-2186ca6fc54c from the persistent domain config.
Nov 29 13:30:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c6a1702-5e65-4648-915d-2186ca6fc54c from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:30:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:30:10 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:30:10 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:30:10 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:30:10 user nova-compute[75071]:   <serial>b38a3474-54a6-46f6-9bca-550ec014db37</serial>
Nov 29 13:30:10 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:30:10 user nova-compute[75071]: </disk>
Nov 29 13:30:10 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:30:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c6a1702-5e65-4648-915d-2186ca6fc54c {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:30:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing instance network info cache due to event network-changed-207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:30:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] Acquiring lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:30:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] Acquired lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:30:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Refreshing network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:30:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updated VIF entry in instance network info cache for port 207bfd05-1208-4348-b44f-a4804aaedf3a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:30:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [{"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f139d09a-c133-4754-b96f-604bc2fdc317 req-5fd1224d-565d-4784-aab3-563d864af6a0 service nova] Releasing lock "refresh_cache-0c6a1702-5e65-4648-915d-2186ca6fc54c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:30:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:27 user nova-compute[75071]: INFO nova.compute.manager [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Terminating instance
Nov 29 13:30:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-295f5a68-8730-4345-b514-b97977bc7093 req-440bc049-b5be-42e8-b2a2-9b1422b5fe82 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received event network-vif-unplugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-295f5a68-8730-4345-b514-b97977bc7093 req-440bc049-b5be-42e8-b2a2-9b1422b5fe82 service nova] Acquiring lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-295f5a68-8730-4345-b514-b97977bc7093 req-440bc049-b5be-42e8-b2a2-9b1422b5fe82 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-295f5a68-8730-4345-b514-b97977bc7093 req-440bc049-b5be-42e8-b2a2-9b1422b5fe82 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-295f5a68-8730-4345-b514-b97977bc7093 req-440bc049-b5be-42e8-b2a2-9b1422b5fe82 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] No waiting events found dispatching network-vif-unplugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-295f5a68-8730-4345-b514-b97977bc7093 req-440bc049-b5be-42e8-b2a2-9b1422b5fe82 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received event network-vif-unplugged-29b0abef-6785-42cc-8538-7de623508452 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:30:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Instance destroyed successfully.
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'resources' on Instance uuid 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:28:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1723757508',display_name='tempest-TestVolumeBootPattern-server-1723757508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1723757508',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-no9kauw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:28:57Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "29b0abef-6785-42cc-8538-7de623508452", "address": "fa:16:3e:fb:51:af", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0abef-67", "ovs_interfaceid": "29b0abef-6785-42cc-8538-7de623508452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:51:af,bridge_name='br-int',has_traffic_filtering=True,id=29b0abef-6785-42cc-8538-7de623508452,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0abef-67') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_vif [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:51:af,bridge_name='br-int',has_traffic_filtering=True,id=29b0abef-6785-42cc-8538-7de623508452,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0abef-67') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29b0abef-67, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2b285c3-b3c5-493c-aa8b-aedac855220f) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: INFO os_vif [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:51:af,bridge_name='br-int',has_traffic_filtering=True,id=29b0abef-6785-42cc-8538-7de623508452,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0abef-67')
Nov 29 13:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CUMOBrfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:30:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb62473-18b1-4024-a330-0a59e68dcbad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:30:28 user nova-compute[75071]: No targets found.
Nov 29 13:30:28 user nova-compute[75071]: iSNS:
Nov 29 13:30:28 user nova-compute[75071]: No targets found.
Nov 29 13:30:28 user nova-compute[75071]: STATIC:
Nov 29 13:30:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1
Nov 29 13:30:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944
Nov 29 13:30:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:30:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37
Nov 29 13:30:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:30:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:30:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6
Nov 29 13:30:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:28 user nova-compute[75071]: FIRMWARE:
Nov 29 13:30:28 user nova-compute[75071]: No targets found.
Nov 29 13:30:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:30:28 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:30:28 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f320d1-32ac-48df-b810-611d87d880b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[208fe3bb-87dd-46ea-b27a-7a2c0bec06a1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:30:28 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:30:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f21487bf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d78c84d-d3f7-49a0-a430-3f4ba058de5d]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e7263-386b-4806-9aa9-88ef0e4a7d1f]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b0dc3-c801-4a6e-959c-7dd228bc5d31]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e3098-ed28-471a-9414-2bda45bb660a]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de5fd9-cff1-4309-831c-bc70cfa67915]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed3847-8524-4787-924a-7986b103f00e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260]
Nov 29 13:30:28 user nova-compute[75071]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6, portal: 172.16.0.220,3260] successful.
Nov 29 13:30:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9491a223-d564-4b44-a705-6d2a9a49a1a0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== disconnect_volume: return (425ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:30:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Deleting instance files /opt/stack/data/nova/instances/3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3_del
Nov 29 13:30:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Deletion of /opt/stack/data/nova/instances/3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3_del complete
Nov 29 13:30:29 user nova-compute[75071]: INFO nova.compute.manager [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 29 13:30:29 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:30:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:29 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Took 0.52 seconds to deallocate network for instance.
Nov 29 13:30:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-63a1de68-1a72-4e8e-b2b8-de242c7caf78 req-f5413084-0fc8-46f9-b2b7-1e023b77d76e service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received event network-vif-deleted-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-978d77b1-ba6f-4cae-acb2-6342244e04ef req-64b323a8-c65b-447e-8e72-d2abd943fe04 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received event network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-978d77b1-ba6f-4cae-acb2-6342244e04ef req-64b323a8-c65b-447e-8e72-d2abd943fe04 service nova] Acquiring lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-978d77b1-ba6f-4cae-acb2-6342244e04ef req-64b323a8-c65b-447e-8e72-d2abd943fe04 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-978d77b1-ba6f-4cae-acb2-6342244e04ef req-64b323a8-c65b-447e-8e72-d2abd943fe04 service nova] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-978d77b1-ba6f-4cae-acb2-6342244e04ef req-64b323a8-c65b-447e-8e72-d2abd943fe04 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] No waiting events found dispatching network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:30:30 user nova-compute[75071]: WARNING nova.compute.manager [req-978d77b1-ba6f-4cae-acb2-6342244e04ef req-64b323a8-c65b-447e-8e72-d2abd943fe04 service nova] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Received unexpected event network-vif-plugged-29b0abef-6785-42cc-8538-7de623508452 for instance with vm_state active and task_state deleting.
Nov 29 13:30:30 user nova-compute[75071]: INFO nova.compute.manager [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Took 0.80 seconds to detach 1 volumes for instance.
Nov 29 13:30:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3] Deleting volume: 1f441f8e-9e6d-4f31-a015-e66cfe55e6b6 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:30:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:31 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Deleted allocations for instance 3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3
Nov 29 13:30:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c6a1702-5e65-4648-915d-2186ca6fc54c is timed out.
Nov 29 13:30:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully detached device vdb from instance 0c6a1702-5e65-4648-915d-2186ca6fc54c from the live domain config.
Nov 29 13:30:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrTLYKko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:30:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0346df-e9a6-4db0-b7bb-35c7b1fc077c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:30:31 user nova-compute[75071]: No targets found.
Nov 29 13:30:31 user nova-compute[75071]: iSNS:
Nov 29 13:30:31 user nova-compute[75071]: No targets found.
Nov 29 13:30:31 user nova-compute[75071]: STATIC:
Nov 29 13:30:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1
Nov 29 13:30:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944
Nov 29 13:30:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:30:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37
Nov 29 13:30:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:30:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:30:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:31 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:31 user nova-compute[75071]: FIRMWARE:
Nov 29 13:30:31 user nova-compute[75071]: No targets found.
Nov 29 13:30:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:30:31 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:30:31 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[450b1443-d674-4c48-821a-ff5cd138ed5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db49f695-0823-4330-ac76-8330f5cd1884 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "3ce69b6e-98ef-44ba-ad23-ed0e5a0294b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.707s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e3308-c6bb-4b41-b7d8-9ca52ce93232]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:30:31 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:30:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148427eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b50c18-45bf-48f2-91cf-c0ccb840ff7f]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42d7d86-5c89-43e5-90a1-0db7d615fdcd]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5056e1-77d9-4a59-8b09-0aac6c3a5104]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f303ca1-e42b-4c1a-9308-2dcd2158ea82]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f851387f-71b4-4f9c-aa4a-a70516d101fa]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00d6e28-0dd4-43c6-a0ac-a66b67958498]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260]
Nov 29 13:30:31 user nova-compute[75071]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37, portal: 172.16.0.220,3260] successful.
Nov 29 13:30:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b38a3474-54a6-46f6-9bca-550ec014db37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4a735b-0845-4163-98d5-77c556409159]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] <== disconnect_volume: return (372ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:30:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:30:32 user nova-compute[75071]: INFO nova.compute.claims [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Claim successful on node user
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:30:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.policy [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57ab074edb904199b8568ef500ce91e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '474e141ca43a458aa529a314e15f3ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:30:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Creating image(s)
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "/opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "/opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk 1073741824" returned: 0 in 0.056s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Successfully created port: b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Cannot resize image /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Ensure instance console log exists: /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Successfully updated port: b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquired lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:30:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-changed-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Refreshing instance network info cache due to event network-changed-b452f374-35e6-43b3-ae62-b144cf266758. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] Acquiring lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updating instance_info_cache with network_info: [{"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Releasing lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Instance network_info: |[{"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] Acquired lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Refreshing network info cache for port b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Start _get_guest_xml network_info=[{"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:30:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:30:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-122808159',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-122808159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1228081',id=29,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6pkjNjf3K0OYIgzInIYh8kyr5U2+9blDoTN1Q8EhgIVBKneQkZdm/J7uqMLJW2OSHkuoHBb14/cP59V/DW57iRc9EmCLF2wSbqdmEnJKDzKiufcNiUOv1tNbxh2DZeIQ==',key_name='tempest-keypair-772556044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='474e141ca43a458aa529a314e15f3ad4',ramdisk_id='',reservation_id='r-d9x0zfw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2024047258',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ab074edb904199b8568ef500ce91e1',uuid=b3c8e702-1259-49c0-9a7f-b6d8877ffa2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Converting VIF {"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2d:fc,bridge_name='br-int',has_traffic_filtering=True,id=b452f374-35e6-43b3-ae62-b144cf266758,network=Network(093f05d5-f7cc-42f3-a423-f147428c06e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb452f374-35') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lazy-loading 'pci_devices' on Instance uuid b3c8e702-1259-49c0-9a7f-b6d8877ffa2b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:30:34 user nova-compute[75071]:   <uuid>b3c8e702-1259-49c0-9a7f-b6d8877ffa2b</uuid>
Nov 29 13:30:34 user nova-compute[75071]:   <name>instance-0000001d</name>
Nov 29 13:30:34 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:30:34 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:30:34 user nova-compute[75071]:   <metadata>
Nov 29 13:30:34 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:30:34 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:30:34 user nova-compute[75071]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-122808159</nova:name>
Nov 29 13:30:34 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:30:34</nova:creationTime>
Nov 29 13:30:34 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:30:34 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:30:34 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:30:34 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:30:34 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:30:34 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:30:34 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:30:34 user nova-compute[75071]:       <nova:owner>
Nov 29 13:30:34 user nova-compute[75071]:         <nova:user uuid="57ab074edb904199b8568ef500ce91e1">tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member</nova:user>
Nov 29 13:30:34 user nova-compute[75071]:         <nova:project uuid="474e141ca43a458aa529a314e15f3ad4">tempest-TestServerVolumeAttachScenarioOldVersion-2024047258</nova:project>
Nov 29 13:30:34 user nova-compute[75071]:       </nova:owner>
Nov 29 13:30:34 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:30:34 user nova-compute[75071]:       <nova:ports>
Nov 29 13:30:34 user nova-compute[75071]:         <nova:port uuid="b452f374-35e6-43b3-ae62-b144cf266758">
Nov 29 13:30:34 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:30:34 user nova-compute[75071]:         </nova:port>
Nov 29 13:30:34 user nova-compute[75071]:       </nova:ports>
Nov 29 13:30:34 user nova-compute[75071]:     </nova:instance>
Nov 29 13:30:34 user nova-compute[75071]:   </metadata>
Nov 29 13:30:34 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:30:34 user nova-compute[75071]:     <system>
Nov 29 13:30:34 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:30:34 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:30:34 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:30:34 user nova-compute[75071]:       <entry name="serial">b3c8e702-1259-49c0-9a7f-b6d8877ffa2b</entry>
Nov 29 13:30:34 user nova-compute[75071]:       <entry name="uuid">b3c8e702-1259-49c0-9a7f-b6d8877ffa2b</entry>
Nov 29 13:30:34 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:30:34 user nova-compute[75071]:     </system>
Nov 29 13:30:34 user nova-compute[75071]:   </sysinfo>
Nov 29 13:30:34 user nova-compute[75071]:   <os>
Nov 29 13:30:34 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:30:34 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:30:34 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:30:34 user nova-compute[75071]:   </os>
Nov 29 13:30:34 user nova-compute[75071]:   <features>
Nov 29 13:30:34 user nova-compute[75071]:     <acpi/>
Nov 29 13:30:34 user nova-compute[75071]:     <apic/>
Nov 29 13:30:34 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:30:34 user nova-compute[75071]:   </features>
Nov 29 13:30:34 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:30:34 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:30:34 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:30:34 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:30:34 user nova-compute[75071]:   </clock>
Nov 29 13:30:34 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:30:34 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:30:34 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:30:34 user nova-compute[75071]:   </cpu>
Nov 29 13:30:34 user nova-compute[75071]:   <devices>
Nov 29 13:30:34 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:30:34 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:30:34 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk"/>
Nov 29 13:30:34 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:30:34 user nova-compute[75071]:     </disk>
Nov 29 13:30:34 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:30:34 user nova-compute[75071]:       <mac address="fa:16:3e:38:2d:fc"/>
Nov 29 13:30:34 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:30:34 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:30:34 user nova-compute[75071]:       <target dev="tapb452f374-35"/>
Nov 29 13:30:34 user nova-compute[75071]:     </interface>
Nov 29 13:30:34 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:30:34 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/console.log" append="off"/>
Nov 29 13:30:34 user nova-compute[75071]:     </serial>
Nov 29 13:30:34 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:30:34 user nova-compute[75071]:     <video>
Nov 29 13:30:34 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:30:34 user nova-compute[75071]:     </video>
Nov 29 13:30:34 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:30:34 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:30:34 user nova-compute[75071]:     </rng>
Nov 29 13:30:34 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:30:34 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:30:34 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:30:34 user nova-compute[75071]:     </memballoon>
Nov 29 13:30:34 user nova-compute[75071]:   </devices>
Nov 29 13:30:34 user nova-compute[75071]: </domain>
Nov 29 13:30:34 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-122808159',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-122808159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1228081',id=29,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6pkjNjf3K0OYIgzInIYh8kyr5U2+9blDoTN1Q8EhgIVBKneQkZdm/J7uqMLJW2OSHkuoHBb14/cP59V/DW57iRc9EmCLF2wSbqdmEnJKDzKiufcNiUOv1tNbxh2DZeIQ==',key_name='tempest-keypair-772556044',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='474e141ca43a458aa529a314e15f3ad4',ramdisk_id='',reservation_id='r-d9x0zfw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2024047258',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ab074edb904199b8568ef500ce91e1',uuid=b3c8e702-1259-49c0-9a7f-b6d8877ffa2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Converting VIF {"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2d:fc,bridge_name='br-int',has_traffic_filtering=True,id=b452f374-35e6-43b3-ae62-b144cf266758,network=Network(093f05d5-f7cc-42f3-a423-f147428c06e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb452f374-35') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG os_vif [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2d:fc,bridge_name='br-int',has_traffic_filtering=True,id=b452f374-35e6-43b3-ae62-b144cf266758,network=Network(093f05d5-f7cc-42f3-a423-f147428c06e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb452f374-35') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9aac4c2b-57fa-5f4f-b9d4-9652792be47b', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb452f374-35, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb452f374-35, col_values=(('qos', UUID('4ce066df-ad91-4c2c-9b11-b36f83120732')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb452f374-35, col_values=(('external_ids', {'iface-id': 'b452f374-35e6-43b3-ae62-b144cf266758', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:2d:fc', 'vm-uuid': 'b3c8e702-1259-49c0-9a7f-b6d8877ffa2b'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:34 user nova-compute[75071]: INFO os_vif [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2d:fc,bridge_name='br-int',has_traffic_filtering=True,id=b452f374-35e6-43b3-ae62-b144cf266758,network=Network(093f05d5-f7cc-42f3-a423-f147428c06e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb452f374-35')
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] No VIF found with MAC fa:16:3e:38:2d:fc, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'flavor' on Instance uuid 0c6a1702-5e65-4648-915d-2186ca6fc54c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9392ec12-e312-49ea-a4b7-b3db975c4871 tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.034s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updated VIF entry in instance network info cache for port b452f374-35e6-43b3-ae62-b144cf266758. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updating instance_info_cache with network_info: [{"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a5c5589-9cd4-4527-bb70-73c9318245a0 req-f0f10d68-81d9-4985-94ad-d6b45108a820 service nova] Releasing lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e532f76-d4fe-4ae0-85e4-2755ee2920bc req-1d8d4c1b-10c8-4667-a3fc-8e88a726d413 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e532f76-d4fe-4ae0-85e4-2755ee2920bc req-1d8d4c1b-10c8-4667-a3fc-8e88a726d413 service nova] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e532f76-d4fe-4ae0-85e4-2755ee2920bc req-1d8d4c1b-10c8-4667-a3fc-8e88a726d413 service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e532f76-d4fe-4ae0-85e4-2755ee2920bc req-1d8d4c1b-10c8-4667-a3fc-8e88a726d413 service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e532f76-d4fe-4ae0-85e4-2755ee2920bc req-1d8d4c1b-10c8-4667-a3fc-8e88a726d413 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] No waiting events found dispatching network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:30:36 user nova-compute[75071]: WARNING nova.compute.manager [req-3e532f76-d4fe-4ae0-85e4-2755ee2920bc req-1d8d4c1b-10c8-4667-a3fc-8e88a726d413 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received unexpected event network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 for instance with vm_state building and task_state spawning.
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e83070a-218d-4f79-bb34-10a5c511c976 req-52576ff1-ba29-470b-a930-2db8af3a080e service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e83070a-218d-4f79-bb34-10a5c511c976 req-52576ff1-ba29-470b-a930-2db8af3a080e service nova] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e83070a-218d-4f79-bb34-10a5c511c976 req-52576ff1-ba29-470b-a930-2db8af3a080e service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e83070a-218d-4f79-bb34-10a5c511c976 req-52576ff1-ba29-470b-a930-2db8af3a080e service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e83070a-218d-4f79-bb34-10a5c511c976 req-52576ff1-ba29-470b-a930-2db8af3a080e service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] No waiting events found dispatching network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:30:38 user nova-compute[75071]: WARNING nova.compute.manager [req-3e83070a-218d-4f79-bb34-10a5c511c976 req-52576ff1-ba29-470b-a930-2db8af3a080e service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received unexpected event network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 for instance with vm_state building and task_state spawning.
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Instance spawned successfully.
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:30:38 user nova-compute[75071]: INFO nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 29 13:30:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:30:38 user nova-compute[75071]: INFO nova.compute.manager [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Took 6.60 seconds to build instance.
Nov 29 13:30:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fd7de2-4c6f-464c-9dab-4f959875337f tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.719s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:45 user nova-compute[75071]: INFO nova.compute.manager [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Detaching volume a934e1b5-90c2-413b-9e54-aa4e304d3944
Nov 29 13:30:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:30:46 user nova-compute[75071]: INFO nova.virt.block_device [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Attempting to driver detach volume a934e1b5-90c2-413b-9e54-aa4e304d3944 from mountpoint /dev/vdc
Nov 29 13:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Attempting to detach device vdc from instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:30:46 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:30:46 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:30:46 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:30:46 user nova-compute[75071]:   <serial>a934e1b5-90c2-413b-9e54-aa4e304d3944</serial>
Nov 29 13:30:46 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:30:46 user nova-compute[75071]: </disk>
Nov 29 13:30:46 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:30:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully detached device vdc from instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 from the persistent domain config.
Nov 29 13:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:30:46 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:30:46 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:30:46 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:30:46 user nova-compute[75071]:   <serial>a934e1b5-90c2-413b-9e54-aa4e304d3944</serial>
Nov 29 13:30:46 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:30:46 user nova-compute[75071]: </disk>
Nov 29 13:30:46 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:30:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:49 user nova-compute[75071]: INFO nova.compute.manager [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Terminating instance
Nov 29 13:30:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-9fab20da-fae2-4022-9297-f170225828e1 req-3b78d582-22c9-4e9b-af30-ff16c65244e0 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-unplugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9fab20da-fae2-4022-9297-f170225828e1 req-3b78d582-22c9-4e9b-af30-ff16c65244e0 service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9fab20da-fae2-4022-9297-f170225828e1 req-3b78d582-22c9-4e9b-af30-ff16c65244e0 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9fab20da-fae2-4022-9297-f170225828e1 req-3b78d582-22c9-4e9b-af30-ff16c65244e0 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-9fab20da-fae2-4022-9297-f170225828e1 req-3b78d582-22c9-4e9b-af30-ff16c65244e0 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-unplugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-9fab20da-fae2-4022-9297-f170225828e1 req-3b78d582-22c9-4e9b-af30-ff16c65244e0 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-unplugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:30:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Instance destroyed successfully.
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lazy-loading 'resources' on Instance uuid 003e4c80-34c6-4c05-a9a7-9da023b7bc0e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-172562232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2077791717',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfBnNA+l6YYtmYNkSg1+7s0Ze1ddryiQfXZLhNcjqMSj8oc5W03kR1glk/dkK9+JrmXvGkDbgD54809kDz8qwdonFyg6AQ17M2qJSInHDXXwV1R8WVChhaoXbQGyjkmag==',key_name='tempest-keypair-1963758755',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:29:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a5dedba01ce4e37a5b067def2eaea80',ramdisk_id='',reservation_id='r-25i14ftg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1240456810',owner_user_name='tempest-ServerActionsV293TestJSON-1240456810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:29:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6af3003b85a4cc281a9d2bbb9465fdb',uuid=003e4c80-34c6-4c05-a9a7-9da023b7bc0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converting VIF {"id": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "address": "fa:16:3e:6d:32:0d", "network": {"id": "a46bff68-f9df-40ef-a194-c4311cb6f63c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1000362604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a5dedba01ce4e37a5b067def2eaea80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b3aaef8-78", "ovs_interfaceid": "3b3aaef8-787e-4dcb-aa02-987d3920cb65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_vif [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b3aaef8-78, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4ba25d1-f559-4825-b6d5-b9c07c04ea2c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:50 user nova-compute[75071]: INFO os_vif [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:32:0d,bridge_name='br-int',has_traffic_filtering=True,id=3b3aaef8-787e-4dcb-aa02-987d3920cb65,network=Network(a46bff68-f9df-40ef-a194-c4311cb6f63c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b3aaef8-78')
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIlVgBcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:30:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df35870-b4c2-4c0a-a843-783c2129ee47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:30:50 user nova-compute[75071]: No targets found.
Nov 29 13:30:50 user nova-compute[75071]: iSNS:
Nov 29 13:30:50 user nova-compute[75071]: No targets found.
Nov 29 13:30:50 user nova-compute[75071]: STATIC:
Nov 29 13:30:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1
Nov 29 13:30:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944
Nov 29 13:30:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:30:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:30:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:50 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:30:50 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:30:50 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:30:50 user nova-compute[75071]: FIRMWARE:
Nov 29 13:30:50 user nova-compute[75071]: No targets found.
Nov 29 13:30:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:30:50 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:30:50 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eebd15-78d2-4919-aa4a-f435bc4b500b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db894587-0c35-4b27-aeec-a4cd6ac7bb7a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:30:50 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:30:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d52b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a0cf32-62d7-4204-9095-695a3eaf869a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b0590-1cd5-47a4-ae3b-087c4a79bd9a]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf174e-a007-4ba1-8378-fbfd83371aa1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[222efd1d-85cc-4a80-887d-0b7a59b3a7ba]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138396437643130', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ea975eb2', '/dev/disk/by-id/scsi-1SCST_BIOea975eb2-a89d7d10530b9b43') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2f12d-ab3f-4d17-8ca2-d9d46394e0af]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd112c1-1c55-4380-9bac-be8eed70b5dd]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8b4355-0131-4b13-afba-c0afc2a80bae]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260]
Nov 29 13:30:50 user nova-compute[75071]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1, portal: 172.16.0.220,3260] successful.
Nov 29 13:30:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b95d97-ae9c-4e05-8ec4-7856a367f9b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff91d79b-848e-4e7a-9382-abb338135b59]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] <== disconnect_volume: return (413ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:30:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Deleting instance files /opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e_del
Nov 29 13:30:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Deletion of /opt/stack/data/nova/instances/003e4c80-34c6-4c05-a9a7-9da023b7bc0e_del complete
Nov 29 13:30:50 user nova-compute[75071]: INFO nova.compute.manager [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:51 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Took 0.72 seconds to deallocate network for instance.
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid '003e4c80-34c6-4c05-a9a7-9da023b7bc0e' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid '003e4c80-34c6-4c05-a9a7-9da023b7bc0e' (instance-00000018)
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-c76bc6c5-27e9-4ccb-8e63-30d6de45669c req-3a34e3f9-617a-454f-b5f7-67bbd1df2510 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c76bc6c5-27e9-4ccb-8e63-30d6de45669c req-3a34e3f9-617a-454f-b5f7-67bbd1df2510 service nova] Acquiring lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c76bc6c5-27e9-4ccb-8e63-30d6de45669c req-3a34e3f9-617a-454f-b5f7-67bbd1df2510 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c76bc6c5-27e9-4ccb-8e63-30d6de45669c req-3a34e3f9-617a-454f-b5f7-67bbd1df2510 service nova] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-c76bc6c5-27e9-4ccb-8e63-30d6de45669c req-3a34e3f9-617a-454f-b5f7-67bbd1df2510 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] No waiting events found dispatching network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:30:52 user nova-compute[75071]: WARNING nova.compute.manager [req-c76bc6c5-27e9-4ccb-8e63-30d6de45669c req-3a34e3f9-617a-454f-b5f7-67bbd1df2510 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received unexpected event network-vif-plugged-3b3aaef8-787e-4dcb-aa02-987d3920cb65 for instance with vm_state active and task_state deleting.
Nov 29 13:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-c76bc6c5-27e9-4ccb-8e63-30d6de45669c req-3a34e3f9-617a-454f-b5f7-67bbd1df2510 service nova] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Received event network-vif-deleted-3b3aaef8-787e-4dcb-aa02-987d3920cb65 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:52 user nova-compute[75071]: INFO nova.compute.manager [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Took 1.04 seconds to detach 1 volumes for instance.
Nov 29 13:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] [instance: 003e4c80-34c6-4c05-a9a7-9da023b7bc0e] Deleting volume: 45b95d97-ae9c-4e05-8ec4-7856a367f9b1 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:53 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Deleted allocations for instance 003e4c80-34c6-4c05-a9a7-9da023b7bc0e
Nov 29 13:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-381d50bd-87a1-4b4f-9704-e5aa4fb6a209 tempest-ServerActionsV293TestJSON-1240456810 tempest-ServerActionsV293TestJSON-1240456810-project-member] Lock "003e4c80-34c6-4c05-a9a7-9da023b7bc0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.089s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:30:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.03841781616211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0c6a1702-5e65-4648-915d-2186ca6fc54c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance daa8724e-64a5-462a-8958-ac034d0b6721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updating instance_info_cache with network_info: [{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-changed-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Refreshing instance network info cache due to event network-changed-b987d810-7434-4a89-bcd5-7aa9cf6b7e35. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] Acquiring lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] Acquired lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Refreshing network info cache for port b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Updated VIF entry in instance network info cache for port b987d810-7434-4a89-bcd5-7aa9cf6b7e35. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Updating instance_info_cache with network_info: [{"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44ba3d33-63f9-48af-bed9-32f7e4508746 req-c8e3b50c-fa52-45de-bbaa-c1382971a54e service nova] Releasing lock "refresh_cache-daa8724e-64a5-462a-8958-ac034d0b6721" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid daa8724e-64a5-462a-8958-ac034d0b6721 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:00 user nova-compute[75071]: INFO nova.compute.manager [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Attaching volume cbc26ccf-e7e7-4386-bd13-a90d47911030 to /dev/vdb
Nov 29 13:31:00 user nova-compute[75071]: DEBUG os_brick.utils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a533fb98-e413-455a-840e-5e7b926285f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc805c21-0d11-48d7-845e-035d8cc45a39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[235efb41-44a7-4e21-a6bd-2207ce501c22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c96e38-1868-45d7-a450-a72980e45767]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:31:01 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:31:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20f537c-80fd-4be4-a7eb-fc4716585b94]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:01 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Updating existing volume attachment record: d5a6e761-6400-4fe9-bc1e-d611651fb057 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:31:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:05 user nova-compute[75071]: INFO nova.compute.manager [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Terminating instance
Nov 29 13:31:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb33e581-7b48-4fe6-b2b3-a48a262f0497 req-f338b45f-ff86-4425-b128-efe81e8c5b49 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb33e581-7b48-4fe6-b2b3-a48a262f0497 req-f338b45f-ff86-4425-b128-efe81e8c5b49 service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb33e581-7b48-4fe6-b2b3-a48a262f0497 req-f338b45f-ff86-4425-b128-efe81e8c5b49 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb33e581-7b48-4fe6-b2b3-a48a262f0497 req-f338b45f-ff86-4425-b128-efe81e8c5b49 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb33e581-7b48-4fe6-b2b3-a48a262f0497 req-f338b45f-ff86-4425-b128-efe81e8c5b49 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb33e581-7b48-4fe6-b2b3-a48a262f0497 req-f338b45f-ff86-4425-b128-efe81e8c5b49 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-unplugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Instance destroyed successfully.
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lazy-loading 'resources' on Instance uuid 0c6a1702-5e65-4648-915d-2186ca6fc54c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2051012330',display_name='tempest-TestMinimumBasicScenario-server-2051012330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2051012330',id=22,image_ref='9e69ac14-d734-4bf7-861d-261ec51390a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeu9GgFSPa6/K+kij4tPOwKDOANbk5u8kY50Refd/RxJ6Ik5+Xn/ONaS5bGXhZEv9OiOh1ALtAe8g0R6P4mubVvN9qq+QEi7+Rpkxhjx0LoI9rHIG+YyMCeeqY5+kBdmQ==',key_name='tempest-TestMinimumBasicScenario-1430741871',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:26:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50f58750d5b84ed9847af078c31c0004',ramdisk_id='',reservation_id='r-9c10ji5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9e69ac14-d734-4bf7-861d-261ec51390a7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-182325840',owner_user_name='tempest-TestMinimumBasicScenario-182325840-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:28:25Z,user_data=None,user_id='0d54f49fa05c4317bb667c1877cb466a',uuid=0c6a1702-5e65-4648-915d-2186ca6fc54c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converting VIF {"id": "207bfd05-1208-4348-b44f-a4804aaedf3a", "address": "fa:16:3e:4f:6c:97", "network": {"id": "aae7024e-5d58-41db-907b-e29904e4ded0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598312055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50f58750d5b84ed9847af078c31c0004", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap207bfd05-12", "ovs_interfaceid": "207bfd05-1208-4348-b44f-a4804aaedf3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6c:97,bridge_name='br-int',has_traffic_filtering=True,id=207bfd05-1208-4348-b44f-a4804aaedf3a,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207bfd05-12') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_vif [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6c:97,bridge_name='br-int',has_traffic_filtering=True,id=207bfd05-1208-4348-b44f-a4804aaedf3a,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207bfd05-12') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap207bfd05-12, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1f447da-9b25-406b-8326-01ce67e0ce74) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:06 user nova-compute[75071]: INFO os_vif [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:6c:97,bridge_name='br-int',has_traffic_filtering=True,id=207bfd05-1208-4348-b44f-a4804aaedf3a,network=Network(aae7024e-5d58-41db-907b-e29904e4ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap207bfd05-12')
Nov 29 13:31:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Deleting instance files /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c_del
Nov 29 13:31:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Deletion of /opt/stack/data/nova/instances/0c6a1702-5e65-4648-915d-2186ca6fc54c_del complete
Nov 29 13:31:06 user nova-compute[75071]: INFO nova.compute.manager [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:31:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 is timed out.
Nov 29 13:31:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully detached device vdc from instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 from the live domain config.
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkaSxiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:06 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fbf7f9-dd07-4e47-8024-0a85b07ff60c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:31:06 user nova-compute[75071]: No targets found.
Nov 29 13:31:06 user nova-compute[75071]: iSNS:
Nov 29 13:31:06 user nova-compute[75071]: No targets found.
Nov 29 13:31:06 user nova-compute[75071]: STATIC:
Nov 29 13:31:06 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944
Nov 29 13:31:06 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:06 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:06 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:31:06 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:06 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:06 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:31:06 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:06 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:06 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:31:06 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:06 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:06 user nova-compute[75071]: FIRMWARE:
Nov 29 13:31:06 user nova-compute[75071]: No targets found.
Nov 29 13:31:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:31:06 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:31:06 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e739ec2-30ca-40fa-aaad-b19914025de8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e324d2-d0c6-4046-88a8-8df793d11666]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:06 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:31:06 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:06 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:06 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 (non-flash)
Nov 29 13:31:06 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:06 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124db9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8906df-36e8-4ef0-8284-63fa44649657]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf287b3-988e-40a9-baf6-38505ed17b62]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d802ba33-4877-4e4f-a144-ccd0e7d046f4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d984ee-52db-4910-96a8-24e8d161409f]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d77d5e-f77a-41b0-a70c-90a7d82d1168]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4405cf9-598e-4882-a924-ebc63b137a95]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260]
Nov 29 13:31:06 user nova-compute[75071]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a934e1b5-90c2-413b-9e54-aa4e304d3944 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee345b6-083f-4c72-9146-e512b2cd0a77]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] <== disconnect_volume: return (347ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:31:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:07 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Took 0.56 seconds to deallocate network for instance.
Nov 29 13:31:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-bd360728-0718-47fc-9367-be62585ac568 req-a803bdd4-3eca-4b9a-b36a-5194b3ff557c service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-deleted-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:07 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:31:07 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:31:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:07 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Deleted allocations for instance 0c6a1702-5e65-4648-915d-2186ca6fc54c
Nov 29 13:31:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-01762c69-f4e8-4879-99e4-b3b1e0da5b8a tempest-TestMinimumBasicScenario-182325840 tempest-TestMinimumBasicScenario-182325840-project-member] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:07 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'flavor' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4abd36a-e020-4f52-800d-277397d9d92a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-45bd2225-9ef4-48a5-aab7-55f0418df62a req-433fe553-ecd2-4b52-bea8-abb4ea88e0c0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-45bd2225-9ef4-48a5-aab7-55f0418df62a req-433fe553-ecd2-4b52-bea8-abb4ea88e0c0 service nova] Acquiring lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-45bd2225-9ef4-48a5-aab7-55f0418df62a req-433fe553-ecd2-4b52-bea8-abb4ea88e0c0 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-45bd2225-9ef4-48a5-aab7-55f0418df62a req-433fe553-ecd2-4b52-bea8-abb4ea88e0c0 service nova] Lock "0c6a1702-5e65-4648-915d-2186ca6fc54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-45bd2225-9ef4-48a5-aab7-55f0418df62a req-433fe553-ecd2-4b52-bea8-abb4ea88e0c0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] No waiting events found dispatching network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:08 user nova-compute[75071]: WARNING nova.compute.manager [req-45bd2225-9ef4-48a5-aab7-55f0418df62a req-433fe553-ecd2-4b52-bea8-abb4ea88e0c0 service nova] [instance: 0c6a1702-5e65-4648-915d-2186ca6fc54c] Received unexpected event network-vif-plugged-207bfd05-1208-4348-b44f-a4804aaedf3a for instance with vm_state deleted and task_state None.
Nov 29 13:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZpKQaOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:08 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:08 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:08 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a664000f-fa84-43f9-afd7-48c4e664008d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:31:08 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b67a5a-1805-444a-9386-4c3c85a5a62f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030] added
Nov 29 13:31:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[536965f7-41cd-405f-a1b7-62a78a9eb39d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d242a435-0ade-483c-a559-604f8aa109d4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZpKQaOF {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZpKQaOF" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb9193e-158a-45f0-a38d-fb3e9856e288]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eZpKQaOF'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca60c5bd-1662-4559-9bd5-f0263e640377]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3a2903-79d8-4cd0-b823-a8da854b37dc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:08 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:08 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:08 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:08 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c37be5f-c2c5-49b1-b66c-818eaebe3ad6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260]
Nov 29 13:31:09 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc4c1c-71cc-4d56-a6ad-0e55e282c9bb]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f411d4c-b319-4126-8803-163177bdcfb3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:09 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:09 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:09 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:09 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:09 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:09 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba961b9a-31dd-4602-b20e-0b71671554f9]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:31:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZpKQaOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23338346561343439', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338346561343439', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid daa8724e-64a5-462a-8958-ac034d0b6721 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:31:10 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:31:10 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:31:10 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:31:10 user nova-compute[75071]:   <serial>cbc26ccf-e7e7-4386-bd13-a90d47911030</serial>
Nov 29 13:31:10 user nova-compute[75071]: </disk>
Nov 29 13:31:10 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No VIF found with MAC fa:16:3e:81:8f:99, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:31:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-889bb179-cfff-4119-b3eb-82bd81da112e tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.867s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:11 user nova-compute[75071]: INFO nova.compute.manager [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Detaching volume cbc26ccf-e7e7-4386-bd13-a90d47911030
Nov 29 13:31:12 user nova-compute[75071]: INFO nova.virt.block_device [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Attempting to driver detach volume cbc26ccf-e7e7-4386-bd13-a90d47911030 from mountpoint /dev/vdb
Nov 29 13:31:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Attempting to detach device vdb from instance daa8724e-64a5-462a-8958-ac034d0b6721 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:31:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:31:12 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:31:12 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:31:12 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:31:12 user nova-compute[75071]:   <serial>cbc26ccf-e7e7-4386-bd13-a90d47911030</serial>
Nov 29 13:31:12 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:31:12 user nova-compute[75071]: </disk>
Nov 29 13:31:12 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:31:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully detached device vdb from instance daa8724e-64a5-462a-8958-ac034d0b6721 from the persistent domain config.
Nov 29 13:31:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance daa8724e-64a5-462a-8958-ac034d0b6721 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:31:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:31:12 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:31:12 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:31:12 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:31:12 user nova-compute[75071]:   <serial>cbc26ccf-e7e7-4386-bd13-a90d47911030</serial>
Nov 29 13:31:12 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:31:12 user nova-compute[75071]: </disk>
Nov 29 13:31:12 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:31:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance daa8724e-64a5-462a-8958-ac034d0b6721 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:31:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-changed-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Refreshing instance network info cache due to event network-changed-c4e3d926-2ca7-42cc-9a76-5bc4db72803e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:31:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:16 user nova-compute[75071]: DEBUG nova.network.neutron [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Refreshing network info cache for port c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:31:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updated VIF entry in instance network info cache for port c4e3d926-2ca7-42cc-9a76-5bc4db72803e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:31:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3a951980-f4a6-4797-aaf0-d6619dd96f50 req-37266a90-b4e9-4f50-be2b-4ef34904d1df service nova] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Stashing vm_state: active {{(pid=75071) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:31:18 user nova-compute[75071]: INFO nova.compute.claims [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Claim successful on node user
Nov 29 13:31:18 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating resource usage from migration 2114b760-fc94-4051-81e8-b9165d5cea83
Nov 29 13:31:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-changed-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Refreshing instance network info cache due to event network-changed-4bf27380-50d5-48e1-bf2d-4bd5cc33020c. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] Acquiring lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] Acquired lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Refreshing network info cache for port 4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:31:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.416s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:18 user nova-compute[75071]: INFO nova.compute.manager [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Migrating
Nov 29 13:31:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updated VIF entry in instance network info cache for port 4bf27380-50d5-48e1-bf2d-4bd5cc33020c. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-66e94b88-4a98-4aae-b43e-6c6aef610eea req-7e3d430d-5ffd-4e02-aee9-409801cfb907 service nova] Releasing lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquired lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Releasing lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Starting migrate_disk_and_power_off {{(pid=75071) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-e4b9dcea-6df6-4278-915e-ad6941c1f08d req-c1c228c9-a8b9-4842-9d87-140c92414ac4 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4b9dcea-6df6-4278-915e-ad6941c1f08d req-c1c228c9-a8b9-4842-9d87-140c92414ac4 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4b9dcea-6df6-4278-915e-ad6941c1f08d req-c1c228c9-a8b9-4842-9d87-140c92414ac4 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4b9dcea-6df6-4278-915e-ad6941c1f08d req-c1c228c9-a8b9-4842-9d87-140c92414ac4 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-e4b9dcea-6df6-4278-915e-ad6941c1f08d req-c1c228c9-a8b9-4842-9d87-140c92414ac4 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:20 user nova-compute[75071]: WARNING nova.compute.manager [req-e4b9dcea-6df6-4278-915e-ad6941c1f08d req-c1c228c9-a8b9-4842-9d87-140c92414ac4 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state resize_migrating.
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance destroyed successfully.
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-553239605',display_name='tempest-ServerActionsTestOtherA-server-553239605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-553239605',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-8xt3hjum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=08de871b-9fc3-4766-b32a-01d809a2d4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507277039-network", "vif_mac": "fa:16:3e:c7:ca:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507277039-network", "vif_mac": "fa:16:3e:c7:ca:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_vif [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bf27380-50, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5f2c428-ce8c-431d-9de8-f18772065000) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:20 user nova-compute[75071]: INFO os_vif [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50')
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:20 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae321319-c588-46fd-9b03-9e407795ae25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:31:20 user nova-compute[75071]: No targets found.
Nov 29 13:31:20 user nova-compute[75071]: iSNS:
Nov 29 13:31:20 user nova-compute[75071]: No targets found.
Nov 29 13:31:20 user nova-compute[75071]: STATIC:
Nov 29 13:31:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030
Nov 29 13:31:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:31:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:31:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:31:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:20 user nova-compute[75071]: FIRMWARE:
Nov 29 13:31:20 user nova-compute[75071]: No targets found.
Nov 29 13:31:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:31:20 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:31:20 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec65dba-5be7-4f02-9815-39091c802818]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43201555-f7f7-468c-9ba5-fab94e01e6a5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:20 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:20 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:20 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:20 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:20 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:20 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fe1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d'): ({'sdg'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Removing single pathed devices sdg {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84a21ce-8451-4453-b4e8-b36d7aac4c43]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[270b5ff8-c9c4-4d9b-8d8e-255a5a77d099]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flushing IO for device /dev/sdg {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af447cfe-eff9-4b55-8171-45eb918c0590]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a9a008-181d-4796-a290-05abeda499ca]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_449317f6', '/dev/disk/by-id/scsi-1SCST_BIO449317f6-8c508a8b9eb2f759', '/dev/disk/by-id/scsi-23863353038613862') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f72c7e1-4df7-4187-9e7a-2d7296e50e2e]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2796ae9a-f247-49cc-b49c-3ce26fb1cab1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfb8ff2-6a3d-424d-8aa2-c17cc4b162f9]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]
Nov 29 13:31:20 user nova-compute[75071]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36843500-d75d-4475-8ebc-31b59ea73d90]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== disconnect_volume: return (308ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:31:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:31:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Port 4bf27380-50d5-48e1-bf2d-4bd5cc33020c binding to destination host user is already ACTIVE {{(pid=75071) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 13:31:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquired lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-6a1231df-ad49-49f1-8a84-3569c6e0a61e req-cd2da717-ac3d-4ccd-a5fc-57b76acc6680 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6a1231df-ad49-49f1-8a84-3569c6e0a61e req-cd2da717-ac3d-4ccd-a5fc-57b76acc6680 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6a1231df-ad49-49f1-8a84-3569c6e0a61e req-cd2da717-ac3d-4ccd-a5fc-57b76acc6680 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6a1231df-ad49-49f1-8a84-3569c6e0a61e req-cd2da717-ac3d-4ccd-a5fc-57b76acc6680 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-6a1231df-ad49-49f1-8a84-3569c6e0a61e req-cd2da717-ac3d-4ccd-a5fc-57b76acc6680 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:22 user nova-compute[75071]: WARNING nova.compute.manager [req-6a1231df-ad49-49f1-8a84-3569c6e0a61e req-cd2da717-ac3d-4ccd-a5fc-57b76acc6680 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state resize_migrated.
Nov 29 13:31:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Releasing lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb56177-96e6-41ed-a388-182bf09075c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff9f63-d4de-4490-8ac7-b829de86c24e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a2c7a-8dd8-40e9-8e4a-0a022f977212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[804e32da-df69-4c81-8827-bbe70ac84a6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:31:22 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:31:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f54a67-7877-4b39-80d4-fdfedc54ac80]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:31:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fcb58221-096b-4275-874f-efb5043b610b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:31:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:31:28 user nova-compute[75071]: INFO nova.compute.claims [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Claim successful on node user
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:31:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.policy [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f902428dcca045ffa81dbd8fd53048b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd1e8292884439b8d49dd698bf812e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:31:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Creating image(s)
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk 1073741824" returned: 0 in 0.051s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Successfully created port: 9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Starting finish_migration {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:31:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Creating image(s)
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Ensure instance console log exists: /opt/stack/data/nova/instances/08de871b-9fc3-4766-b32a-01d809a2d4c1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Start _get_guest_xml network_info=[{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507277039-network", "vif_mac": "fa:16:3e:c7:ca:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '08de871b-9fc3-4766-b32a-01d809a2d4c1', 'attached_at': '2023-11-29T13:31:30.000000', 'detached_at': '', 'volume_id': '3604afe3-29c9-401a-ac33-2cdb4841849d', 'serial': '3604afe3-29c9-401a-ac33-2cdb4841849d'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'c646377e-fc2a-4192-ab7c-46480a407f48', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:31:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:30 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76631142-9f34-427d-8af6-204340b718d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:31:30 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Cannot resize image /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Ensure instance console log exists: /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c15946-8652-4f0a-ae15-d87479c09b1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d] added
Nov 29 13:31:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8448ab8b-ff02-47cc-9619-b2e204f51fa7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf63c66-48c4-4e34-9412-8cde01a49ea8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgnjvOrc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgnjvOrc" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea8ed27-7786-4ac0-9d4e-c51f0c0e7458]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BgnjvOrc'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[666adc99-ef11-4f77-9081-75975d340e6d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d897b-b41f-4077-9ded-04baa3e36975]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8408bf74-ea8c-4af0-96ff-6ce0c896f83a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]
Nov 29 13:31:30 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c062bc-082d-48f7-bfeb-dd9e5e6dc471]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5673f856-c544-4733-85d6-82f0f0102455]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:30 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d7224-47c5-495d-81c1-4d6479b30313]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Successfully updated port: 9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received event network-changed-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Refreshing instance network info cache due to event network-changed-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] Acquiring lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Updating instance_info_cache with network_info: [{"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Instance network_info: |[{"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] Acquired lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Refreshing network info cache for port 9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Start _get_guest_xml network_info=[{"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:31:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2118985663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2118985663',id=30,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-lrxa2tat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:31:30Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=fcb58221-096b-4275-874f-efb5043b610b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:21:f5,bridge_name='br-int',has_traffic_filtering=True,id=9d08334b-3a27-45ee-8f5c-a6cf4d2654d6,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d08334b-3a') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'pci_devices' on Instance uuid fcb58221-096b-4275-874f-efb5043b610b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:31:31 user nova-compute[75071]:   <uuid>fcb58221-096b-4275-874f-efb5043b610b</uuid>
Nov 29 13:31:31 user nova-compute[75071]:   <name>instance-0000001e</name>
Nov 29 13:31:31 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:31:31 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:31:31 user nova-compute[75071]:   <metadata>
Nov 29 13:31:31 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:31:31 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2118985663</nova:name>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:31:31</nova:creationTime>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:31:31 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:31:31 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:owner>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:user uuid="f902428dcca045ffa81dbd8fd53048b6">tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member</nova:user>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:project uuid="ecd1e8292884439b8d49dd698bf812e1">tempest-ServerBootFromVolumeStableRescueTest-398011867</nova:project>
Nov 29 13:31:31 user nova-compute[75071]:       </nova:owner>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:ports>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:port uuid="9d08334b-3a27-45ee-8f5c-a6cf4d2654d6">
Nov 29 13:31:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:31:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:31:31 user nova-compute[75071]:       </nova:ports>
Nov 29 13:31:31 user nova-compute[75071]:     </nova:instance>
Nov 29 13:31:31 user nova-compute[75071]:   </metadata>
Nov 29 13:31:31 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:31:31 user nova-compute[75071]:     <system>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="serial">fcb58221-096b-4275-874f-efb5043b610b</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="uuid">fcb58221-096b-4275-874f-efb5043b610b</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:31:31 user nova-compute[75071]:     </system>
Nov 29 13:31:31 user nova-compute[75071]:   </sysinfo>
Nov 29 13:31:31 user nova-compute[75071]:   <os>
Nov 29 13:31:31 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:31:31 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:31:31 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:31:31 user nova-compute[75071]:   </os>
Nov 29 13:31:31 user nova-compute[75071]:   <features>
Nov 29 13:31:31 user nova-compute[75071]:     <acpi/>
Nov 29 13:31:31 user nova-compute[75071]:     <apic/>
Nov 29 13:31:31 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:31:31 user nova-compute[75071]:   </features>
Nov 29 13:31:31 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:31:31 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:31:31 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:31:31 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:31:31 user nova-compute[75071]:   </clock>
Nov 29 13:31:31 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:31:31 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:31:31 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:31:31 user nova-compute[75071]:   </cpu>
Nov 29 13:31:31 user nova-compute[75071]:   <devices>
Nov 29 13:31:31 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:31:31 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:31:31 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk"/>
Nov 29 13:31:31 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:31:31 user nova-compute[75071]:     </disk>
Nov 29 13:31:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:31:31 user nova-compute[75071]:       <mac address="fa:16:3e:fa:21:f5"/>
Nov 29 13:31:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:31:31 user nova-compute[75071]:       <target dev="tap9d08334b-3a"/>
Nov 29 13:31:31 user nova-compute[75071]:     </interface>
Nov 29 13:31:31 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:31:31 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/console.log" append="off"/>
Nov 29 13:31:31 user nova-compute[75071]:     </serial>
Nov 29 13:31:31 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:31:31 user nova-compute[75071]:     <video>
Nov 29 13:31:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:31 user nova-compute[75071]:     </video>
Nov 29 13:31:31 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:31:31 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:31:31 user nova-compute[75071]:     </rng>
Nov 29 13:31:31 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:31:31 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:31:31 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:31:31 user nova-compute[75071]:     </memballoon>
Nov 29 13:31:31 user nova-compute[75071]:   </devices>
Nov 29 13:31:31 user nova-compute[75071]: </domain>
Nov 29 13:31:31 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2118985663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2118985663',id=30,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-lrxa2tat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:31:30Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=fcb58221-096b-4275-874f-efb5043b610b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:21:f5,bridge_name='br-int',has_traffic_filtering=True,id=9d08334b-3a27-45ee-8f5c-a6cf4d2654d6,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d08334b-3a') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG os_vif [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:21:f5,bridge_name='br-int',has_traffic_filtering=True,id=9d08334b-3a27-45ee-8f5c-a6cf4d2654d6,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d08334b-3a') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '545e63a4-7c2b-582f-a3c7-f0520c16fd96', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d08334b-3a, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d08334b-3a, col_values=(('qos', UUID('afb92b42-cbd3-4f53-82ae-27b91e054ad4')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d08334b-3a, col_values=(('external_ids', {'iface-id': '9d08334b-3a27-45ee-8f5c-a6cf4d2654d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:21:f5', 'vm-uuid': 'fcb58221-096b-4275-874f-efb5043b610b'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: INFO os_vif [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:21:f5,bridge_name='br-int',has_traffic_filtering=True,id=9d08334b-3a27-45ee-8f5c-a6cf4d2654d6,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d08334b-3a')
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No VIF found with MAC fa:16:3e:fa:21:f5, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Updated VIF entry in instance network info cache for port 9d08334b-3a27-45ee-8f5c-a6cf4d2654d6. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Updating instance_info_cache with network_info: [{"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5642d9d0-e140-4b2c-b4cd-ea1d590fd2d7 req-adaf7047-eda8-40d1-b546-c700ab76f4f8 service nova] Releasing lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23863353038613862', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863353038613862', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-553239605',display_name='tempest-ServerActionsTestOtherA-server-553239605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-553239605',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-8xt3hjum',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:31:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=08de871b-9fc3-4766-b32a-01d809a2d4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507277039-network", "vif_mac": "fa:16:3e:c7:ca:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507277039-network", "vif_mac": "fa:16:3e:c7:ca:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:31:31 user nova-compute[75071]:   <uuid>08de871b-9fc3-4766-b32a-01d809a2d4c1</uuid>
Nov 29 13:31:31 user nova-compute[75071]:   <name>instance-0000001c</name>
Nov 29 13:31:31 user nova-compute[75071]:   <memory>2097152</memory>
Nov 29 13:31:31 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:31:31 user nova-compute[75071]:   <metadata>
Nov 29 13:31:31 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:31:31 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-553239605</nova:name>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:31:30</nova:creationTime>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:flavor name="m1.small">
Nov 29 13:31:31 user nova-compute[75071]:         <nova:memory>2048</nova:memory>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:disk>20</nova:disk>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:31:31 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:owner>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:user uuid="8395b32f70af4fd782ad81a609e9f63a">tempest-ServerActionsTestOtherA-611751521-project-member</nova:user>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:project uuid="36f5f5e7553949989e7fc90db828a0bd">tempest-ServerActionsTestOtherA-611751521</nova:project>
Nov 29 13:31:31 user nova-compute[75071]:       </nova:owner>
Nov 29 13:31:31 user nova-compute[75071]:       <nova:ports>
Nov 29 13:31:31 user nova-compute[75071]:         <nova:port uuid="4bf27380-50d5-48e1-bf2d-4bd5cc33020c">
Nov 29 13:31:31 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 13:31:31 user nova-compute[75071]:         </nova:port>
Nov 29 13:31:31 user nova-compute[75071]:       </nova:ports>
Nov 29 13:31:31 user nova-compute[75071]:     </nova:instance>
Nov 29 13:31:31 user nova-compute[75071]:   </metadata>
Nov 29 13:31:31 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:31:31 user nova-compute[75071]:     <system>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="serial">08de871b-9fc3-4766-b32a-01d809a2d4c1</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="uuid">08de871b-9fc3-4766-b32a-01d809a2d4c1</entry>
Nov 29 13:31:31 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:31:31 user nova-compute[75071]:     </system>
Nov 29 13:31:31 user nova-compute[75071]:   </sysinfo>
Nov 29 13:31:31 user nova-compute[75071]:   <os>
Nov 29 13:31:31 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:31:31 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:31:31 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:31:31 user nova-compute[75071]:   </os>
Nov 29 13:31:31 user nova-compute[75071]:   <features>
Nov 29 13:31:31 user nova-compute[75071]:     <acpi/>
Nov 29 13:31:31 user nova-compute[75071]:     <apic/>
Nov 29 13:31:31 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:31:31 user nova-compute[75071]:   </features>
Nov 29 13:31:31 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:31:31 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:31:31 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:31:31 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:31:31 user nova-compute[75071]:   </clock>
Nov 29 13:31:31 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:31:31 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:31:31 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:31:31 user nova-compute[75071]:   </cpu>
Nov 29 13:31:31 user nova-compute[75071]:   <devices>
Nov 29 13:31:31 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:31:31 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:31:31 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Nov 29 13:31:31 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:31:31 user nova-compute[75071]:       <serial>3604afe3-29c9-401a-ac33-2cdb4841849d</serial>
Nov 29 13:31:31 user nova-compute[75071]:     </disk>
Nov 29 13:31:31 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:31:31 user nova-compute[75071]:       <mac address="fa:16:3e:c7:ca:fe"/>
Nov 29 13:31:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:31 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:31:31 user nova-compute[75071]:       <target dev="tap4bf27380-50"/>
Nov 29 13:31:31 user nova-compute[75071]:     </interface>
Nov 29 13:31:31 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:31:31 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/08de871b-9fc3-4766-b32a-01d809a2d4c1/console.log" append="off"/>
Nov 29 13:31:31 user nova-compute[75071]:     </serial>
Nov 29 13:31:31 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:31:31 user nova-compute[75071]:     <video>
Nov 29 13:31:31 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:31 user nova-compute[75071]:     </video>
Nov 29 13:31:31 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:31:31 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:31:31 user nova-compute[75071]:     </rng>
Nov 29 13:31:31 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:31:31 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:31:31 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:31:31 user nova-compute[75071]:     </memballoon>
Nov 29 13:31:31 user nova-compute[75071]:   </devices>
Nov 29 13:31:31 user nova-compute[75071]: </domain>
Nov 29 13:31:31 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-553239605',display_name='tempest-ServerActionsTestOtherA-server-553239605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-553239605',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-8xt3hjum',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:31:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=08de871b-9fc3-4766-b32a-01d809a2d4c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507277039-network", "vif_mac": "fa:16:3e:c7:ca:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507277039-network", "vif_mac": "fa:16:3e:c7:ca:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG os_vif [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4216f730-05a2-5892-8a9a-f402a137eccb', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bf27380-50, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bf27380-50, col_values=(('qos', UUID('d7650936-374f-46f4-b3cc-53b5e8176601')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bf27380-50, col_values=(('external_ids', {'iface-id': '4bf27380-50d5-48e1-bf2d-4bd5cc33020c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:ca:fe', 'vm-uuid': '08de871b-9fc3-4766-b32a-01d809a2d4c1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:31 user nova-compute[75071]: INFO os_vif [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50')
Nov 29 13:31:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] No VIF found with MAC fa:16:3e:c7:ca:fe, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:31:32 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance daa8724e-64a5-462a-8958-ac034d0b6721 is timed out.
Nov 29 13:31:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully detached device vdb from instance daa8724e-64a5-462a-8958-ac034d0b6721 from the live domain config.
Nov 29 13:31:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZpKQaOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:32 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f381440-cba8-4473-b45f-b9cafefe61a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:31:32 user nova-compute[75071]: No targets found.
Nov 29 13:31:32 user nova-compute[75071]: iSNS:
Nov 29 13:31:32 user nova-compute[75071]: No targets found.
Nov 29 13:31:32 user nova-compute[75071]: STATIC:
Nov 29 13:31:32 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030
Nov 29 13:31:32 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:32 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:32 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:31:32 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:32 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:32 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:31:32 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:32 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:32 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:31:32 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:32 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:32 user nova-compute[75071]: FIRMWARE:
Nov 29 13:31:32 user nova-compute[75071]: No targets found.
Nov 29 13:31:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:31:32 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:31:32 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6d3098-ddae-4b1d-a4e3-3c196b91d766]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc7a385-5c89-4bc6-a739-ded78b3102d1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:32 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:32 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:32 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:32 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:32 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 (non-flash)
Nov 29 13:31:32 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fe2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab102695-f901-4d2e-a86f-1250300c1a51]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e346d618-d6d4-4ce6-8b64-d548bb80952e]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda8b0aa-1366-48b2-b6f2-7c6a0efe8735]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5d1731-8565-4c64-b3af-19aac6ab747a]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc82916-9f7b-435d-befa-bc0d19aa2965]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd41289-4000-47b6-8d5c-674919c1b6c4]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260]
Nov 29 13:31:32 user nova-compute[75071]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbc26ccf-e7e7-4386-bd13-a90d47911030 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fad4e6-d10b-4a21-8205-067c24903b74]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== disconnect_volume: return (322ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid daa8724e-64a5-462a-8958-ac034d0b6721 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6820c95-1ea6-4e0f-9d83-7accbae10032 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.695s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-61e6f684-5d7a-4f35-b731-186ba7ec6218 req-0f5a5479-ff85-4396-8d9a-36739cbb1642 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received event network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61e6f684-5d7a-4f35-b731-186ba7ec6218 req-0f5a5479-ff85-4396-8d9a-36739cbb1642 service nova] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61e6f684-5d7a-4f35-b731-186ba7ec6218 req-0f5a5479-ff85-4396-8d9a-36739cbb1642 service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61e6f684-5d7a-4f35-b731-186ba7ec6218 req-0f5a5479-ff85-4396-8d9a-36739cbb1642 service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-61e6f684-5d7a-4f35-b731-186ba7ec6218 req-0f5a5479-ff85-4396-8d9a-36739cbb1642 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] No waiting events found dispatching network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:33 user nova-compute[75071]: WARNING nova.compute.manager [req-61e6f684-5d7a-4f35-b731-186ba7ec6218 req-0f5a5479-ff85-4396-8d9a-36739cbb1642 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received unexpected event network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 for instance with vm_state building and task_state spawning.
Nov 29 13:31:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-61e2fb26-2741-48ec-844f-f731c72372f9 req-fae51946-00e6-4db4-be19-a3673c2849e3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61e2fb26-2741-48ec-844f-f731c72372f9 req-fae51946-00e6-4db4-be19-a3673c2849e3 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61e2fb26-2741-48ec-844f-f731c72372f9 req-fae51946-00e6-4db4-be19-a3673c2849e3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61e2fb26-2741-48ec-844f-f731c72372f9 req-fae51946-00e6-4db4-be19-a3673c2849e3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-61e2fb26-2741-48ec-844f-f731c72372f9 req-fae51946-00e6-4db4-be19-a3673c2849e3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:34 user nova-compute[75071]: WARNING nova.compute.manager [req-61e2fb26-2741-48ec-844f-f731c72372f9 req-fae51946-00e6-4db4-be19-a3673c2849e3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state resize_finish.
Nov 29 13:31:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca07bd54-521c-4e6b-9fe4-1b317092beaa req-f38ee275-accd-4fad-afe3-c8eed6cc4f5d service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received event network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca07bd54-521c-4e6b-9fe4-1b317092beaa req-f38ee275-accd-4fad-afe3-c8eed6cc4f5d service nova] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca07bd54-521c-4e6b-9fe4-1b317092beaa req-f38ee275-accd-4fad-afe3-c8eed6cc4f5d service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca07bd54-521c-4e6b-9fe4-1b317092beaa req-f38ee275-accd-4fad-afe3-c8eed6cc4f5d service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca07bd54-521c-4e6b-9fe4-1b317092beaa req-f38ee275-accd-4fad-afe3-c8eed6cc4f5d service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] No waiting events found dispatching network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:35 user nova-compute[75071]: WARNING nova.compute.manager [req-ca07bd54-521c-4e6b-9fe4-1b317092beaa req-f38ee275-accd-4fad-afe3-c8eed6cc4f5d service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received unexpected event network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 for instance with vm_state building and task_state spawning.
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:36 user nova-compute[75071]: INFO nova.compute.manager [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Terminating instance
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-2074f194-cb58-4487-8ba9-07f0eb786363 req-5c92c5a8-4591-47e6-a7a5-3a90a178c916 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2074f194-cb58-4487-8ba9-07f0eb786363 req-5c92c5a8-4591-47e6-a7a5-3a90a178c916 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2074f194-cb58-4487-8ba9-07f0eb786363 req-5c92c5a8-4591-47e6-a7a5-3a90a178c916 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2074f194-cb58-4487-8ba9-07f0eb786363 req-5c92c5a8-4591-47e6-a7a5-3a90a178c916 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-2074f194-cb58-4487-8ba9-07f0eb786363 req-5c92c5a8-4591-47e6-a7a5-3a90a178c916 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:36 user nova-compute[75071]: WARNING nova.compute.manager [req-2074f194-cb58-4487-8ba9-07f0eb786363 req-5c92c5a8-4591-47e6-a7a5-3a90a178c916 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state resize_finish.
Nov 29 13:31:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:31:36 user nova-compute[75071]: INFO nova.compute.claims [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Claim successful on node user
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance running successfully.
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Failed to set time: agent not configured {{(pid=75071) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-49d1f6bd-492f-4f27-90d7-b8164c17fc0f tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] finish_migration finished successfully. {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:31:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: fcb58221-096b-4275-874f-efb5043b610b] Instance spawned successfully.
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:36 user nova-compute[75071]: INFO nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 29 13:31:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:31:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:36 user nova-compute[75071]: INFO nova.compute.manager [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Took 8.06 seconds to build instance.
Nov 29 13:31:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2919e460-4ffd-4d96-a1d7-ccc68b3c1950 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fcb58221-096b-4275-874f-efb5043b610b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.224s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.805s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:31:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Instance destroyed successfully.
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'resources' on Instance uuid 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:25:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1897835708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1897835708',id=20,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXsJ5XQa2UWegE5sMjsQzlXf2iXtgaMgOt29b5FNqf5KhFVTOCjbdjPWgrKECK3+uPt8/RcqdROcEYKm0ZLCBWwPc3xPwy8nYxmWLtQaXOoiEiqMokCgoy016PpX/yRuA==',key_name='tempest-keypair-973435994',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:29:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-3z5pz8a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:29:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=73c90d9c-3089-4d7b-9ac9-7c2105cd4649,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "address": "fa:16:3e:01:d1:6a", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b97467c-89", "ovs_interfaceid": "8b97467c-89dd-4ec6-b403-1dcee24246e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG os_vif [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b97467c-89, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91a0f6e9-e03e-48ba-929c-ccc82ded95ac) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:37 user nova-compute[75071]: INFO os_vif [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=8b97467c-89dd-4ec6-b403-1dcee24246e1,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b97467c-89')
Nov 29 13:31:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Deleting instance files /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649_del
Nov 29 13:31:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Deletion of /opt/stack/data/nova/instances/73c90d9c-3089-4d7b-9ac9-7c2105cd4649_del complete
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:31:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:31:37 user nova-compute[75071]: INFO nova.compute.manager [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.policy [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32b037a2bbef4090a2317bfeedd8e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b75ecae6764ce1801dbab6253ac6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:31:37 user nova-compute[75071]: INFO nova.virt.block_device [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Booting with volume 94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 at /dev/vda
Nov 29 13:31:37 user nova-compute[75071]: DEBUG os_brick.utils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e84d3-dd9e-4976-9a15-e82dc96f44a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4facf24a-9a96-4201-aa55-7419d7fdcf63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[65114308-51c2-415a-b578-99e8f977b0d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc9314c-3b90-449a-b41b-0e3bfd8b10f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:31:37 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f49892-c56c-4eba-b5af-fe02ea08a7f3]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG os_brick.utils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updating existing volume attachment record: 31d04daf-775c-4e43-ae50-a3e7468890e2 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-unplugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-unplugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-unplugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] Acquiring lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] No waiting events found dispatching network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:37 user nova-compute[75071]: WARNING nova.compute.manager [req-36e6c0a9-62ea-457d-8d10-c674f3b2773f req-43ad1d62-7fb8-49dc-ac53-088389c5934c service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received unexpected event network-vif-plugged-8b97467c-89dd-4ec6-b403-1dcee24246e1 for instance with vm_state active and task_state deleting.
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Successfully created port: f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:38 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Took 1.03 seconds to deallocate network for instance.
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-a80f63b5-25c4-409c-8bc6-f04c5e19096b req-0e9ec0ec-081c-4a0f-a816-fc67978367f5 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Received event network-vif-deleted-8b97467c-89dd-4ec6-b403-1dcee24246e1 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:38 user nova-compute[75071]: INFO nova.compute.manager [req-a80f63b5-25c4-409c-8bc6-f04c5e19096b req-0e9ec0ec-081c-4a0f-a816-fc67978367f5 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Neutron deleted interface 8b97467c-89dd-4ec6-b403-1dcee24246e1; detaching it from the instance and deleting it from the info cache
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-a80f63b5-25c4-409c-8bc6-f04c5e19096b req-0e9ec0ec-081c-4a0f-a816-fc67978367f5 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-a80f63b5-25c4-409c-8bc6-f04c5e19096b req-0e9ec0ec-081c-4a0f-a816-fc67978367f5 service nova] [instance: 73c90d9c-3089-4d7b-9ac9-7c2105cd4649] Detach interface failed, port_id=8b97467c-89dd-4ec6-b403-1dcee24246e1, reason: Instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Successfully updated port: f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquired lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-changed-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Refreshing instance network info cache due to event network-changed-f4114f62-6b07-4f02-9663-f1095f018f53. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] Acquiring lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:31:38 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:39 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Deleted allocations for instance 73c90d9c-3089-4d7b-9ac9-7c2105cd4649
Nov 29 13:31:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dc0ca65b-6288-45a8-aa87-4dbb17508545 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "73c90d9c-3089-4d7b-9ac9-7c2105cd4649" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.874s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updating instance_info_cache with network_info: [{"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Releasing lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Instance network_info: |[{"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] Acquired lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Refreshing network info cache for port f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updated VIF entry in instance network info cache for port f4114f62-6b07-4f02-9663-f1095f018f53. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updating instance_info_cache with network_info: [{"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1650ff04-9ffc-4139-bce9-18dea825cdca req-df4f58fe-a2cc-4e48-a794-8673f7f126f9 service nova] Releasing lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:31:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Creating image(s)
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Ensure instance console log exists: /opt/stack/data/nova/instances/b6ed42c9-2b8c-4f2a-930e-81ba854778be/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Start _get_guest_xml network_info=[{"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmshICuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6ed42c9-2b8c-4f2a-930e-81ba854778be', 'attached_at': '', 'detached_at': '', 'volume_id': '94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7', 'serial': '94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '31d04daf-775c-4e43-ae50-a3e7468890e2', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:31:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmshICuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:46 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:46 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:46 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22376825-6f09-4490-ac26-1a9d590e8e82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:31:46 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe94680-0ee7-41d1-b153-5d7ba398cc75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7] added
Nov 29 13:31:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[863b85c7-5497-4569-a7ff-6e3a2d3d3bba]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c01b6-5693-47e7-a90f-132b2515acca]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmshICuH {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmshICuH" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df93d7b-06bc-4b67-a4e8-c0d6b0fab3b2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TmshICuH'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a6a8d-5f08-4f4b-bb7a-bd1b9f625028]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d694ee1-3033-40bf-b216-bbeebc6b089f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[87597183-8f15-44ce-bd25-952e6f149c79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260]
Nov 29 13:31:46 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66f418c-1df7-46fe-839e-8b83cacd15c8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc3d8c-27cf-457a-8765-e184cbdee2b4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:46 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc1670e-31f7-477c-bd75-e5dc7614182f]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:31:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmshICuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26662326163663735', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662326163663735', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-928000202',display_name='tempest-TestVolumeBootPattern-volume-backed-server-928000202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-928000202',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlncUKhJODS8bDP2iD5JX44F5O8Xnr3YVeB7zhBvTRmlLBSgCueVcjAdhgNV4abehGVx+meFJ0eZhgHAew79Xi/xLyiLph80U3tYOwWux6F2h3Y4GtTAjUGJOlPTVT5Tw==',key_name='tempest-keypair-358548769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-00lr1u6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=b6ed42c9-2b8c-4f2a-930e-81ba854778be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:3d:7b,bridge_name='br-int',has_traffic_filtering=True,id=f4114f62-6b07-4f02-9663-f1095f018f53,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4114f62-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'pci_devices' on Instance uuid b6ed42c9-2b8c-4f2a-930e-81ba854778be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:31:47 user nova-compute[75071]:   <uuid>b6ed42c9-2b8c-4f2a-930e-81ba854778be</uuid>
Nov 29 13:31:47 user nova-compute[75071]:   <name>instance-0000001f</name>
Nov 29 13:31:47 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:31:47 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:31:47 user nova-compute[75071]:   <metadata>
Nov 29 13:31:47 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:31:47 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:31:47 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-928000202</nova:name>
Nov 29 13:31:47 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:31:46</nova:creationTime>
Nov 29 13:31:47 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:31:47 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:31:47 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:31:47 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:31:47 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:31:47 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:31:47 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:31:47 user nova-compute[75071]:       <nova:owner>
Nov 29 13:31:47 user nova-compute[75071]:         <nova:user uuid="32b037a2bbef4090a2317bfeedd8e155">tempest-TestVolumeBootPattern-2055293783-project-member</nova:user>
Nov 29 13:31:47 user nova-compute[75071]:         <nova:project uuid="86b75ecae6764ce1801dbab6253ac6c4">tempest-TestVolumeBootPattern-2055293783</nova:project>
Nov 29 13:31:47 user nova-compute[75071]:       </nova:owner>
Nov 29 13:31:47 user nova-compute[75071]:       <nova:ports>
Nov 29 13:31:47 user nova-compute[75071]:         <nova:port uuid="f4114f62-6b07-4f02-9663-f1095f018f53">
Nov 29 13:31:47 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 13:31:47 user nova-compute[75071]:         </nova:port>
Nov 29 13:31:47 user nova-compute[75071]:       </nova:ports>
Nov 29 13:31:47 user nova-compute[75071]:     </nova:instance>
Nov 29 13:31:47 user nova-compute[75071]:   </metadata>
Nov 29 13:31:47 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:31:47 user nova-compute[75071]:     <system>
Nov 29 13:31:47 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:31:47 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:31:47 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:31:47 user nova-compute[75071]:       <entry name="serial">b6ed42c9-2b8c-4f2a-930e-81ba854778be</entry>
Nov 29 13:31:47 user nova-compute[75071]:       <entry name="uuid">b6ed42c9-2b8c-4f2a-930e-81ba854778be</entry>
Nov 29 13:31:47 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:31:47 user nova-compute[75071]:     </system>
Nov 29 13:31:47 user nova-compute[75071]:   </sysinfo>
Nov 29 13:31:47 user nova-compute[75071]:   <os>
Nov 29 13:31:47 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:31:47 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:31:47 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:31:47 user nova-compute[75071]:   </os>
Nov 29 13:31:47 user nova-compute[75071]:   <features>
Nov 29 13:31:47 user nova-compute[75071]:     <acpi/>
Nov 29 13:31:47 user nova-compute[75071]:     <apic/>
Nov 29 13:31:47 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:31:47 user nova-compute[75071]:   </features>
Nov 29 13:31:47 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:31:47 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:31:47 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:31:47 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:31:47 user nova-compute[75071]:   </clock>
Nov 29 13:31:47 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:31:47 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:31:47 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:31:47 user nova-compute[75071]:   </cpu>
Nov 29 13:31:47 user nova-compute[75071]:   <devices>
Nov 29 13:31:47 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:31:47 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:31:47 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Nov 29 13:31:47 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:31:47 user nova-compute[75071]:       <serial>94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7</serial>
Nov 29 13:31:47 user nova-compute[75071]:     </disk>
Nov 29 13:31:47 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:31:47 user nova-compute[75071]:       <mac address="fa:16:3e:ef:3d:7b"/>
Nov 29 13:31:47 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:47 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:31:47 user nova-compute[75071]:       <target dev="tapf4114f62-6b"/>
Nov 29 13:31:47 user nova-compute[75071]:     </interface>
Nov 29 13:31:47 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:31:47 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/b6ed42c9-2b8c-4f2a-930e-81ba854778be/console.log" append="off"/>
Nov 29 13:31:47 user nova-compute[75071]:     </serial>
Nov 29 13:31:47 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:31:47 user nova-compute[75071]:     <video>
Nov 29 13:31:47 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:47 user nova-compute[75071]:     </video>
Nov 29 13:31:47 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:31:47 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:31:47 user nova-compute[75071]:     </rng>
Nov 29 13:31:47 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:31:47 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:31:47 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:31:47 user nova-compute[75071]:     </memballoon>
Nov 29 13:31:47 user nova-compute[75071]:   </devices>
Nov 29 13:31:47 user nova-compute[75071]: </domain>
Nov 29 13:31:47 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-928000202',display_name='tempest-TestVolumeBootPattern-volume-backed-server-928000202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-928000202',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlncUKhJODS8bDP2iD5JX44F5O8Xnr3YVeB7zhBvTRmlLBSgCueVcjAdhgNV4abehGVx+meFJ0eZhgHAew79Xi/xLyiLph80U3tYOwWux6F2h3Y4GtTAjUGJOlPTVT5Tw==',key_name='tempest-keypair-358548769',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-00lr1u6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:31:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=b6ed42c9-2b8c-4f2a-930e-81ba854778be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:3d:7b,bridge_name='br-int',has_traffic_filtering=True,id=f4114f62-6b07-4f02-9663-f1095f018f53,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4114f62-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG os_vif [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:3d:7b,bridge_name='br-int',has_traffic_filtering=True,id=f4114f62-6b07-4f02-9663-f1095f018f53,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4114f62-6b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e3349de-74f5-52f9-90a2-1232242b18b2', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4114f62-6b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4114f62-6b, col_values=(('qos', UUID('abba884c-55a4-4474-aacb-b93fd34a9912')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4114f62-6b, col_values=(('external_ids', {'iface-id': 'f4114f62-6b07-4f02-9663-f1095f018f53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:3d:7b', 'vm-uuid': 'b6ed42c9-2b8c-4f2a-930e-81ba854778be'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:47 user nova-compute[75071]: INFO os_vif [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:3d:7b,bridge_name='br-int',has_traffic_filtering=True,id=f4114f62-6b07-4f02-9663-f1095f018f53,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4114f62-6b')
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No VIF found with MAC fa:16:3e:ef:3d:7b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:31:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquired lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:31:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'info_cache' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.objects.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-5eb19f76-f8c8-4330-aa0c-f54eeea22494 req-819fbc49-5a6f-4c86-bdb8-cc93a664f43f service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5eb19f76-f8c8-4330-aa0c-f54eeea22494 req-819fbc49-5a6f-4c86-bdb8-cc93a664f43f service nova] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5eb19f76-f8c8-4330-aa0c-f54eeea22494 req-819fbc49-5a6f-4c86-bdb8-cc93a664f43f service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5eb19f76-f8c8-4330-aa0c-f54eeea22494 req-819fbc49-5a6f-4c86-bdb8-cc93a664f43f service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-5eb19f76-f8c8-4330-aa0c-f54eeea22494 req-819fbc49-5a6f-4c86-bdb8-cc93a664f43f service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] No waiting events found dispatching network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:49 user nova-compute[75071]: WARNING nova.compute.manager [req-5eb19f76-f8c8-4330-aa0c-f54eeea22494 req-819fbc49-5a6f-4c86-bdb8-cc93a664f43f service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received unexpected event network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 for instance with vm_state building and task_state spawning.
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating instance_info_cache with network_info: [{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Releasing lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance destroyed successfully.
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'resources' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.objects.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_vif [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a2c6093-ff, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb4c5fe7-8a07-4897-b506-ba1ec0d3bb92) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:49 user nova-compute[75071]: INFO os_vif [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff')
Nov 29 13:31:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BGkOXpse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d6aa2-57ca-440a-be8c-bc0a3dcc238e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:31:49 user nova-compute[75071]: No targets found.
Nov 29 13:31:49 user nova-compute[75071]: iSNS:
Nov 29 13:31:49 user nova-compute[75071]: No targets found.
Nov 29 13:31:49 user nova-compute[75071]: STATIC:
Nov 29 13:31:49 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7
Nov 29 13:31:49 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:49 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:49 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:31:49 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:49 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:49 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:31:49 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:49 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:49 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:31:49 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:31:49 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:31:49 user nova-compute[75071]: FIRMWARE:
Nov 29 13:31:49 user nova-compute[75071]: No targets found.
Nov 29 13:31:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:31:49 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:31:49 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a3e37a-2d1d-4d2f-8f3f-5c57e8e99ebc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8025f55-3082-4037-a1c6-fe3ccfd2f0ae]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:49 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:49 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:49 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:49 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:49 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:49 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e389d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39'): ({'sdh'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Removing single pathed devices sdh {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b74b1f-fd8e-40f3-8dd6-e3f0e923874c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95584e0f-65f5-4ef0-9b66-201d57d207b7]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flushing IO for device /dev/sdh {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034f2c3-d9c1-4350-a3e7-c939eba7bb2c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[514630ff-0e68-49be-88a8-9f5fa15cda00]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d283b-bb23-4d9a-9ade-29e38005cc3a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e37190-1120-4ed0-ab6f-957dc3cb9d2b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]
Nov 29 13:31:50 user nova-compute[75071]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc97d4-430e-4a79-b7b9-51e6ff7d8789]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== disconnect_volume: return (338ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Start _get_guest_xml network_info=[{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BGkOXpse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'f9101862-4ab0-4973-84a7-411ab276084d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4b7c2d2-4b60-460b-902c-706d82921a39', 'serial': 'f4b7c2d2-4b60-460b-902c-706d82921a39'}, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'attachment_id': '1fad5cad-3931-4d2b-ac1e-a3956dd8d9ac', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'numa_topology' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.objects.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:31:50 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:50 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.objects.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BGkOXpse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:31:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:31:50 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7570bdfe-1730-4472-8847-925c5d225c34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:31:50 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.063s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b75063-55bc-4c55-b0c6-29522ff9b5a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39] added
Nov 29 13:31:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197ee38-8a3e-4267-ad82-5543961cd57a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3561144-f2dc-4440-9208-172951d2701f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BGkOXpse {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BGkOXpse" returned: 0 in 0.148s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8efea8-8a5a-4e1e-820e-5f240a37935b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BGkOXpse'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba12f641-ac1d-44d6-a488-71fea553f7ba]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c85ef38-00c9-41b1-a7ff-09eba6a9e7eb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e6aaf-a6b4-4676-a6d5-876a3912101c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]
Nov 29 13:31:50 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.
Nov 29 13:31:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c12e60-80da-4c46-b23d-b7b0f5b527f3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd4e7dc-9e4c-44d7-a8da-70f3f4c1a5e0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:31:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea03df59-21a1-43a2-8337-93d2c7e8e821]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BGkOXpse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-c7483e95-02d0-4bef-b57c-2e6755b0dc3c req-b88ad30c-55d3-460f-8699-609d9adb840c service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c7483e95-02d0-4bef-b57c-2e6755b0dc3c req-b88ad30c-55d3-460f-8699-609d9adb840c service nova] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c7483e95-02d0-4bef-b57c-2e6755b0dc3c req-b88ad30c-55d3-460f-8699-609d9adb840c service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c7483e95-02d0-4bef-b57c-2e6755b0dc3c req-b88ad30c-55d3-460f-8699-609d9adb840c service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-c7483e95-02d0-4bef-b57c-2e6755b0dc3c req-b88ad30c-55d3-460f-8699-609d9adb840c service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] No waiting events found dispatching network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:51 user nova-compute[75071]: WARNING nova.compute.manager [req-c7483e95-02d0-4bef-b57c-2e6755b0dc3c req-b88ad30c-55d3-460f-8699-609d9adb840c service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received unexpected event network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 for instance with vm_state building and task_state spawning.
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:31:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Instance spawned successfully.
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:51 user nova-compute[75071]: INFO nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:31:51 user nova-compute[75071]: INFO nova.compute.manager [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Took 15.44 seconds to build instance.
Nov 29 13:31:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.500s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26534663766306438', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534663766306438', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-219b3d61-a5c2-4528-9d2a-9735355ed99d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.567s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'pci_devices' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.objects.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:31:51 user nova-compute[75071]:   <uuid>f9101862-4ab0-4973-84a7-411ab276084d</uuid>
Nov 29 13:31:51 user nova-compute[75071]:   <name>instance-00000019</name>
Nov 29 13:31:51 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:31:51 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:31:51 user nova-compute[75071]:   <metadata>
Nov 29 13:31:51 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:31:51 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:31:51 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-489273326</nova:name>
Nov 29 13:31:51 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:31:50</nova:creationTime>
Nov 29 13:31:51 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:31:51 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:31:51 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:31:51 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:31:51 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:31:51 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:31:51 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:31:51 user nova-compute[75071]:       <nova:owner>
Nov 29 13:31:51 user nova-compute[75071]:         <nova:user uuid="80b78150bab7440daf6d7fe0d25d4cf2">tempest-AttachVolumeTestJSON-964246432-project-member</nova:user>
Nov 29 13:31:51 user nova-compute[75071]:         <nova:project uuid="9fead1ec3dc0456eb2dd2290009247a9">tempest-AttachVolumeTestJSON-964246432</nova:project>
Nov 29 13:31:51 user nova-compute[75071]:       </nova:owner>
Nov 29 13:31:51 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:31:51 user nova-compute[75071]:       <nova:ports>
Nov 29 13:31:51 user nova-compute[75071]:         <nova:port uuid="2a2c6093-ffca-45b4-95f9-b612afba26a5">
Nov 29 13:31:51 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:31:51 user nova-compute[75071]:         </nova:port>
Nov 29 13:31:51 user nova-compute[75071]:       </nova:ports>
Nov 29 13:31:51 user nova-compute[75071]:     </nova:instance>
Nov 29 13:31:51 user nova-compute[75071]:   </metadata>
Nov 29 13:31:51 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:31:51 user nova-compute[75071]:     <system>
Nov 29 13:31:51 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:31:51 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:31:51 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:31:51 user nova-compute[75071]:       <entry name="serial">f9101862-4ab0-4973-84a7-411ab276084d</entry>
Nov 29 13:31:51 user nova-compute[75071]:       <entry name="uuid">f9101862-4ab0-4973-84a7-411ab276084d</entry>
Nov 29 13:31:51 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:31:51 user nova-compute[75071]:     </system>
Nov 29 13:31:51 user nova-compute[75071]:   </sysinfo>
Nov 29 13:31:51 user nova-compute[75071]:   <os>
Nov 29 13:31:51 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:31:51 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:31:51 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:31:51 user nova-compute[75071]:   </os>
Nov 29 13:31:51 user nova-compute[75071]:   <features>
Nov 29 13:31:51 user nova-compute[75071]:     <acpi/>
Nov 29 13:31:51 user nova-compute[75071]:     <apic/>
Nov 29 13:31:51 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:31:51 user nova-compute[75071]:   </features>
Nov 29 13:31:51 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:31:51 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:31:51 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:31:51 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:31:51 user nova-compute[75071]:   </clock>
Nov 29 13:31:51 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:31:51 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:31:51 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:31:51 user nova-compute[75071]:   </cpu>
Nov 29 13:31:51 user nova-compute[75071]:   <devices>
Nov 29 13:31:51 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:31:51 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:31:51 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk"/>
Nov 29 13:31:51 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:31:51 user nova-compute[75071]:     </disk>
Nov 29 13:31:51 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:31:51 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:31:51 user nova-compute[75071]:       <source dev="/dev/sde"/>
Nov 29 13:31:51 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:31:51 user nova-compute[75071]:       <serial>f4b7c2d2-4b60-460b-902c-706d82921a39</serial>
Nov 29 13:31:51 user nova-compute[75071]:     </disk>
Nov 29 13:31:51 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:31:51 user nova-compute[75071]:       <mac address="fa:16:3e:a4:e6:92"/>
Nov 29 13:31:51 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:51 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:31:51 user nova-compute[75071]:       <target dev="tap2a2c6093-ff"/>
Nov 29 13:31:51 user nova-compute[75071]:     </interface>
Nov 29 13:31:51 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:31:51 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/console.log" append="off"/>
Nov 29 13:31:51 user nova-compute[75071]:     </serial>
Nov 29 13:31:51 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:31:51 user nova-compute[75071]:     <video>
Nov 29 13:31:51 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:31:51 user nova-compute[75071]:     </video>
Nov 29 13:31:51 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:31:51 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:31:51 user nova-compute[75071]:     </rng>
Nov 29 13:31:51 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:31:51 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:31:51 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:31:51 user nova-compute[75071]:     </memballoon>
Nov 29 13:31:51 user nova-compute[75071]:   </devices>
Nov 29 13:31:51 user nova-compute[75071]: </domain>
Nov 29 13:31:51 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.objects.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Cannot resize image /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'migration_context' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.objects.base [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG os_vif [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bf45b21-28d5-5af4-9a3b-34a7225378fa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a2c6093-ff, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a2c6093-ff, col_values=(('qos', UUID('a56dd59f-4833-47d0-b188-604b57c39eff')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a2c6093-ff, col_values=(('external_ids', {'iface-id': '2a2c6093-ffca-45b4-95f9-b612afba26a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:e6:92', 'vm-uuid': 'f9101862-4ab0-4973-84a7-411ab276084d'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:52 user nova-compute[75071]: INFO os_vif [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff')
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:31:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7822MB free_disk=25.027015686035156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Applying migration context for instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 as it has an incoming, in-progress migration 2114b760-fc94-4051-81e8-b9165d5cea83. Migration status is finished {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 13:31:53 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating resource usage from migration 2114b760-fc94-4051-81e8-b9165d5cea83
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance daa8724e-64a5-462a-8958-ac034d0b6721 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Migration 2114b760-fc94-4051-81e8-b9165d5cea83 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b6ed42c9-2b8c-4f2a-930e-81ba854778be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:31:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-24e32795-4015-488f-8e25-60d10598d6a6 req-07caf68b-7026-4119-a0cf-0a510639e0ee service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-24e32795-4015-488f-8e25-60d10598d6a6 req-07caf68b-7026-4119-a0cf-0a510639e0ee service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-24e32795-4015-488f-8e25-60d10598d6a6 req-07caf68b-7026-4119-a0cf-0a510639e0ee service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-24e32795-4015-488f-8e25-60d10598d6a6 req-07caf68b-7026-4119-a0cf-0a510639e0ee service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-24e32795-4015-488f-8e25-60d10598d6a6 req-07caf68b-7026-4119-a0cf-0a510639e0ee service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:54 user nova-compute[75071]: WARNING nova.compute.manager [req-24e32795-4015-488f-8e25-60d10598d6a6 req-07caf68b-7026-4119-a0cf-0a510639e0ee service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state powering-on.
Nov 29 13:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-bcda0a79-4d38-47fc-a218-2f3131f507dc req-72eee906-440f-4bbb-b60d-86a3d59ffad1 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bcda0a79-4d38-47fc-a218-2f3131f507dc req-72eee906-440f-4bbb-b60d-86a3d59ffad1 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bcda0a79-4d38-47fc-a218-2f3131f507dc req-72eee906-440f-4bbb-b60d-86a3d59ffad1 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bcda0a79-4d38-47fc-a218-2f3131f507dc req-72eee906-440f-4bbb-b60d-86a3d59ffad1 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-bcda0a79-4d38-47fc-a218-2f3131f507dc req-72eee906-440f-4bbb-b60d-86a3d59ffad1 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:31:56 user nova-compute[75071]: WARNING nova.compute.manager [req-bcda0a79-4d38-47fc-a218-2f3131f507dc req-72eee906-440f-4bbb-b60d-86a3d59ffad1 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state powering-on.
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:31:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance rebooted successfully.
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e8ee89b-83ec-4eab-800d-323e4e60e2d5 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating instance_info_cache with network_info: [{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:31:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:31:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:02 user nova-compute[75071]: INFO nova.compute.manager [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Terminating instance
Nov 29 13:32:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-5afa7754-c449-43a0-96ef-740465f72ac1 req-c15cc757-5266-4b12-998a-5bcff074a814 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-vif-unplugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5afa7754-c449-43a0-96ef-740465f72ac1 req-c15cc757-5266-4b12-998a-5bcff074a814 service nova] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5afa7754-c449-43a0-96ef-740465f72ac1 req-c15cc757-5266-4b12-998a-5bcff074a814 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5afa7754-c449-43a0-96ef-740465f72ac1 req-c15cc757-5266-4b12-998a-5bcff074a814 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-5afa7754-c449-43a0-96ef-740465f72ac1 req-c15cc757-5266-4b12-998a-5bcff074a814 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] No waiting events found dispatching network-vif-unplugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-5afa7754-c449-43a0-96ef-740465f72ac1 req-c15cc757-5266-4b12-998a-5bcff074a814 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-vif-unplugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Instance destroyed successfully.
Nov 29 13:32:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'resources' on Instance uuid daa8724e-64a5-462a-8958-ac034d0b6721 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-539973920',display_name='tempest-AttachVolumeNegativeTest-server-539973920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-539973920',id=27,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGl7B5wdgCUgm3qV6w64Nu6upkQaZw8I6LFuugjANNqs3yTD00NMmol9gtkFdRO/DHR1+1hJeWsSLyhU57hhpFMJurYlL2dL9A0aibHrKp8nye0gZSy+BfqGi5DKChd/Q==',key_name='tempest-keypair-236222793',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:29:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-lf7h021t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:29:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=daa8724e-64a5-462a-8958-ac034d0b6721,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "address": "fa:16:3e:81:8f:99", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb987d810-74", "ovs_interfaceid": "b987d810-7434-4a89-bcd5-7aa9cf6b7e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:8f:99,bridge_name='br-int',has_traffic_filtering=True,id=b987d810-7434-4a89-bcd5-7aa9cf6b7e35,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987d810-74') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG os_vif [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8f:99,bridge_name='br-int',has_traffic_filtering=True,id=b987d810-7434-4a89-bcd5-7aa9cf6b7e35,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987d810-74') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb987d810-74, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f32bcf7-119e-4e86-bfd4-00ddd57636b7) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:32:03 user nova-compute[75071]: INFO os_vif [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8f:99,bridge_name='br-int',has_traffic_filtering=True,id=b987d810-7434-4a89-bcd5-7aa9cf6b7e35,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb987d810-74')
Nov 29 13:32:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Deleting instance files /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721_del
Nov 29 13:32:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Deletion of /opt/stack/data/nova/instances/daa8724e-64a5-462a-8958-ac034d0b6721_del complete
Nov 29 13:32:03 user nova-compute[75071]: INFO nova.compute.manager [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 13:32:03 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:32:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:32:04 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Took 0.98 seconds to deallocate network for instance.
Nov 29 13:32:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-b0dd0b89-c860-4d6a-9fa6-380109d71375 req-c8dcfb7e-1a48-4bbc-8d2a-ca2df00d65c9 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-vif-deleted-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-878a53f4-121b-4a64-bc7c-16ea5d9b8f98 req-413e81c5-41db-4f8a-bc7b-2cf0dc227c18 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received event network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-878a53f4-121b-4a64-bc7c-16ea5d9b8f98 req-413e81c5-41db-4f8a-bc7b-2cf0dc227c18 service nova] Acquiring lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-878a53f4-121b-4a64-bc7c-16ea5d9b8f98 req-413e81c5-41db-4f8a-bc7b-2cf0dc227c18 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-878a53f4-121b-4a64-bc7c-16ea5d9b8f98 req-413e81c5-41db-4f8a-bc7b-2cf0dc227c18 service nova] Lock "daa8724e-64a5-462a-8958-ac034d0b6721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-878a53f4-121b-4a64-bc7c-16ea5d9b8f98 req-413e81c5-41db-4f8a-bc7b-2cf0dc227c18 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] No waiting events found dispatching network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:32:04 user nova-compute[75071]: WARNING nova.compute.manager [req-878a53f4-121b-4a64-bc7c-16ea5d9b8f98 req-413e81c5-41db-4f8a-bc7b-2cf0dc227c18 service nova] [instance: daa8724e-64a5-462a-8958-ac034d0b6721] Received unexpected event network-vif-plugged-b987d810-7434-4a89-bcd5-7aa9cf6b7e35 for instance with vm_state deleted and task_state None.
Nov 29 13:32:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:04 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Deleted allocations for instance daa8724e-64a5-462a-8958-ac034d0b6721
Nov 29 13:32:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0538b3ef-567f-4c3d-9f5a-3878bce137f5 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "daa8724e-64a5-462a-8958-ac034d0b6721" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-changed-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Refreshing instance network info cache due to event network-changed-b452f374-35e6-43b3-ae62-b144cf266758. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:32:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] Acquiring lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:32:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] Acquired lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:32:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Refreshing network info cache for port b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:32:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updated VIF entry in instance network info cache for port b452f374-35e6-43b3-ae62-b144cf266758. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:32:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updating instance_info_cache with network_info: [{"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:32:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4f2d713-8d29-4e4a-a102-a75f13174d39 req-61ba6ef0-0c4f-4fbf-b107-ca727877d4e2 service nova] Releasing lock "refresh_cache-b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lazy-loading 'flavor' on Instance uuid b3c8e702-1259-49c0-9a7f-b6d8877ffa2b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:27 user nova-compute[75071]: INFO nova.compute.manager [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Attaching volume aeefdda1-8ad4-4095-a789-f76c277fc976 to /dev/vdb
Nov 29 13:32:27 user nova-compute[75071]: DEBUG os_brick.utils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5000a8-233e-4a9b-bb05-276eed18e3c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cc4cc0-a59d-4484-92b0-ff0ae3b47b6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57373ba-1218-4198-a288-bdf01bed8446]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff229d16-2b98-4a55-8e4e-20e938710ef4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:32:27 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:32:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95237d5-be21-4227-9653-bbfb24a96538]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG os_brick.utils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:32:27 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updating existing volume attachment record: 2b2835b1-0dc7-4767-9081-85d4adae31bc {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:32:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:32:30 user nova-compute[75071]: INFO nova.compute.claims [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Claim successful on node user
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:32:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.policy [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '013770deb90c4a83a4a822afdc45a2b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34bfa3e9f6b47beb18fb97da4bfb176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:32:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Creating image(s)
Nov 29 13:32:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.235s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk 1073741824" returned: 0 in 0.061s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Successfully created port: 8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Cannot resize image /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Ensure instance console log exists: /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Successfully updated port: 8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquired lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing instance network info cache due to event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] Acquiring lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Releasing lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance network_info: |[{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] Acquired lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Start _get_guest_xml network_info=[{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:32:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:32:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-468125726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-468125726',id=32,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnEvpwLVwhA6iy3tz3v3R0fiS+WPfBzsMVdWoYBaM9OSMZpIjrwyYVB6spM1rKu3nJ13UulkADDc7mLe20T6IE6LPZD26bH00I8jG21iN2Y4DIO4RBD8jJ5Jb70bo8+A==',key_name='tempest-keypair-1169509056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-7ikhq3le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=9f62ede8-a1ed-411a-9720-b187674f974f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:32:33 user nova-compute[75071]:   <uuid>9f62ede8-a1ed-411a-9720-b187674f974f</uuid>
Nov 29 13:32:33 user nova-compute[75071]:   <name>instance-00000020</name>
Nov 29 13:32:33 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:32:33 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:32:33 user nova-compute[75071]:   <metadata>
Nov 29 13:32:33 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:32:33 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:32:33 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-468125726</nova:name>
Nov 29 13:32:33 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:32:33</nova:creationTime>
Nov 29 13:32:33 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:32:33 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:32:33 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:32:33 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:32:33 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:32:33 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:32:33 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:32:33 user nova-compute[75071]:       <nova:owner>
Nov 29 13:32:33 user nova-compute[75071]:         <nova:user uuid="013770deb90c4a83a4a822afdc45a2b9">tempest-AttachVolumeShelveTestJSON-2031472443-project-member</nova:user>
Nov 29 13:32:33 user nova-compute[75071]:         <nova:project uuid="c34bfa3e9f6b47beb18fb97da4bfb176">tempest-AttachVolumeShelveTestJSON-2031472443</nova:project>
Nov 29 13:32:33 user nova-compute[75071]:       </nova:owner>
Nov 29 13:32:33 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:32:33 user nova-compute[75071]:       <nova:ports>
Nov 29 13:32:33 user nova-compute[75071]:         <nova:port uuid="8a523b75-f9bb-49e1-bca9-a09400acd9ab">
Nov 29 13:32:33 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 13:32:33 user nova-compute[75071]:         </nova:port>
Nov 29 13:32:33 user nova-compute[75071]:       </nova:ports>
Nov 29 13:32:33 user nova-compute[75071]:     </nova:instance>
Nov 29 13:32:33 user nova-compute[75071]:   </metadata>
Nov 29 13:32:33 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:32:33 user nova-compute[75071]:     <system>
Nov 29 13:32:33 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:32:33 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:32:33 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:32:33 user nova-compute[75071]:       <entry name="serial">9f62ede8-a1ed-411a-9720-b187674f974f</entry>
Nov 29 13:32:33 user nova-compute[75071]:       <entry name="uuid">9f62ede8-a1ed-411a-9720-b187674f974f</entry>
Nov 29 13:32:33 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:32:33 user nova-compute[75071]:     </system>
Nov 29 13:32:33 user nova-compute[75071]:   </sysinfo>
Nov 29 13:32:33 user nova-compute[75071]:   <os>
Nov 29 13:32:33 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:32:33 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:32:33 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:32:33 user nova-compute[75071]:   </os>
Nov 29 13:32:33 user nova-compute[75071]:   <features>
Nov 29 13:32:33 user nova-compute[75071]:     <acpi/>
Nov 29 13:32:33 user nova-compute[75071]:     <apic/>
Nov 29 13:32:33 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:32:33 user nova-compute[75071]:   </features>
Nov 29 13:32:33 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:32:33 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:32:33 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:32:33 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:32:33 user nova-compute[75071]:   </clock>
Nov 29 13:32:33 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:32:33 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:32:33 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:32:33 user nova-compute[75071]:   </cpu>
Nov 29 13:32:33 user nova-compute[75071]:   <devices>
Nov 29 13:32:33 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:32:33 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:32:33 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk"/>
Nov 29 13:32:33 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:32:33 user nova-compute[75071]:     </disk>
Nov 29 13:32:33 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:32:33 user nova-compute[75071]:       <mac address="fa:16:3e:cb:ff:c3"/>
Nov 29 13:32:33 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:32:33 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:32:33 user nova-compute[75071]:       <target dev="tap8a523b75-f9"/>
Nov 29 13:32:33 user nova-compute[75071]:     </interface>
Nov 29 13:32:33 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:32:33 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/console.log" append="off"/>
Nov 29 13:32:33 user nova-compute[75071]:     </serial>
Nov 29 13:32:33 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:32:33 user nova-compute[75071]:     <video>
Nov 29 13:32:33 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:32:33 user nova-compute[75071]:     </video>
Nov 29 13:32:33 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:32:33 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:32:33 user nova-compute[75071]:     </rng>
Nov 29 13:32:33 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:32:33 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:32:33 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:32:33 user nova-compute[75071]:     </memballoon>
Nov 29 13:32:33 user nova-compute[75071]:   </devices>
Nov 29 13:32:33 user nova-compute[75071]: </domain>
Nov 29 13:32:33 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-468125726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-468125726',id=32,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnEvpwLVwhA6iy3tz3v3R0fiS+WPfBzsMVdWoYBaM9OSMZpIjrwyYVB6spM1rKu3nJ13UulkADDc7mLe20T6IE6LPZD26bH00I8jG21iN2Y4DIO4RBD8jJ5Jb70bo8+A==',key_name='tempest-keypair-1169509056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-7ikhq3le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=9f62ede8-a1ed-411a-9720-b187674f974f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG os_vif [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fa2e5a0-0e8c-591b-8790-49e6376eda4f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a523b75-f9, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a523b75-f9, col_values=(('qos', UUID('59a7f563-5d64-4c5d-b408-bbc9651ecb28')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a523b75-f9, col_values=(('external_ids', {'iface-id': '8a523b75-f9bb-49e1-bca9-a09400acd9ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ff:c3', 'vm-uuid': '9f62ede8-a1ed-411a-9720-b187674f974f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:33 user nova-compute[75071]: INFO os_vif [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9')
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:32:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No VIF found with MAC fa:16:3e:cb:ff:c3, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:32:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updated VIF entry in instance network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:32:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:32:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7cb7a96-590b-4646-85c4-e7e9f2f76451 req-9e17c8b0-cd9a-45e3-ace5-d71847eed91f service nova] Releasing lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ec8b976-42d9-42f7-8a02-4ddc94fac79c req-b1b47b0c-f9ab-4659-96fd-93c6ec1c0947 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ec8b976-42d9-42f7-8a02-4ddc94fac79c req-b1b47b0c-f9ab-4659-96fd-93c6ec1c0947 service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ec8b976-42d9-42f7-8a02-4ddc94fac79c req-b1b47b0c-f9ab-4659-96fd-93c6ec1c0947 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ec8b976-42d9-42f7-8a02-4ddc94fac79c req-b1b47b0c-f9ab-4659-96fd-93c6ec1c0947 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ec8b976-42d9-42f7-8a02-4ddc94fac79c req-b1b47b0c-f9ab-4659-96fd-93c6ec1c0947 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:32:35 user nova-compute[75071]: WARNING nova.compute.manager [req-6ec8b976-42d9-42f7-8a02-4ddc94fac79c req-b1b47b0c-f9ab-4659-96fd-93c6ec1c0947 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received unexpected event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with vm_state building and task_state spawning.
Nov 29 13:32:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPHDyGlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:32:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:32:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:32:35 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4315c5-dfd8-488b-bc04-12adb4bae0b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:32:35 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c309ec-45c2-4827-90fd-7e7e97259c2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976] added
Nov 29 13:32:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb1c53-e603-4c1d-8194-afc79d152f68]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ff1c96-03a9-472f-ab93-8b8be4faf902]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPHDyGlY {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPHDyGlY" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52491594-3236-4ae3-962b-127b1ed72cc8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPHDyGlY'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[845ed7ca-1c22-42cd-8364-357d7bd1fc23]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17265a13-8b74-42cd-a73b-29cba0a35926]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:32:35 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:32:35 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:32:35 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:32:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:32:35 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:32:35 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:32:35 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:32:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aef05c-b82e-46b2-ac47-c7886c8901b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260]
Nov 29 13:32:36 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260] successful.
Nov 29 13:32:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d414d052-acd1-4b42-a9df-9cfe6e4c6a70]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d8b77-c279-4e2c-84ad-808b913c93e8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 (non-flash)
Nov 29 13:32:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4009565e-0389-49ec-bb0b-c1a17325e4ff]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPHDyGlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23965646261613237', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965646261613237', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lazy-loading 'flavor' on Instance uuid b3c8e702-1259-49c0-9a7f-b6d8877ffa2b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:32:37 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:32:37 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:32:37 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:32:37 user nova-compute[75071]:   <serial>aeefdda1-8ad4-4095-a789-f76c277fc976</serial>
Nov 29 13:32:37 user nova-compute[75071]: </disk>
Nov 29 13:32:37 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] No VIF found with MAC fa:16:3e:38:2d:fc, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-1c54450e-3182-43e9-9a48-346642368887 req-b2abcc39-6716-470c-b385-49181650537b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1c54450e-3182-43e9-9a48-346642368887 req-b2abcc39-6716-470c-b385-49181650537b service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1c54450e-3182-43e9-9a48-346642368887 req-b2abcc39-6716-470c-b385-49181650537b service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1c54450e-3182-43e9-9a48-346642368887 req-b2abcc39-6716-470c-b385-49181650537b service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-1c54450e-3182-43e9-9a48-346642368887 req-b2abcc39-6716-470c-b385-49181650537b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:32:37 user nova-compute[75071]: WARNING nova.compute.manager [req-1c54450e-3182-43e9-9a48-346642368887 req-b2abcc39-6716-470c-b385-49181650537b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received unexpected event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with vm_state building and task_state spawning.
Nov 29 13:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-80e6b793-79e9-45d0-b47c-02ba204b82fd tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.719s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:32:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance spawned successfully.
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:32:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:32:38 user nova-compute[75071]: INFO nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 29 13:32:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:32:38 user nova-compute[75071]: INFO nova.compute.manager [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Took 7.32 seconds to build instance.
Nov 29 13:32:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a82beba-dbda-404e-b636-88332fae791a tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.436s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:39 user nova-compute[75071]: INFO nova.compute.manager [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Detaching volume aeefdda1-8ad4-4095-a789-f76c277fc976
Nov 29 13:32:39 user nova-compute[75071]: INFO nova.virt.block_device [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Attempting to driver detach volume aeefdda1-8ad4-4095-a789-f76c277fc976 from mountpoint /dev/vdb
Nov 29 13:32:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Attempting to detach device vdb from instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:32:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:32:39 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:32:39 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:32:39 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:32:39 user nova-compute[75071]:   <serial>aeefdda1-8ad4-4095-a789-f76c277fc976</serial>
Nov 29 13:32:39 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:32:39 user nova-compute[75071]: </disk>
Nov 29 13:32:39 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:32:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Successfully detached device vdb from instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b from the persistent domain config.
Nov 29 13:32:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:32:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:32:39 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:32:39 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Nov 29 13:32:39 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:32:39 user nova-compute[75071]:   <serial>aeefdda1-8ad4-4095-a789-f76c277fc976</serial>
Nov 29 13:32:39 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:32:39 user nova-compute[75071]: </disk>
Nov 29 13:32:39 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:32:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:32:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:32:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:32:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:32:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:32:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:32:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7710MB free_disk=25.086898803710938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Applying migration context for instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 as it has an incoming, in-progress migration 2114b760-fc94-4051-81e8-b9165d5cea83. Migration status is finished {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 13:32:54 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating resource usage from migration 2114b760-fc94-4051-81e8-b9165d5cea83
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Migration 2114b760-fc94-4051-81e8-b9165d5cea83 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b6ed42c9-2b8c-4f2a-930e-81ba854778be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9f62ede8-a1ed-411a-9720-b187674f974f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:32:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:32:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:32:56 user nova-compute[75071]: INFO nova.compute.claims [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Claim successful on node user
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating instance_info_cache with network_info: [{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:32:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.policy [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '350e0cf65eeb441582c203ac06668009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f00a9cd6fd4b4398314100706a720b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:32:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Creating image(s)
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "/opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk 1073741824" returned: 0 in 0.056s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Successfully created port: 178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Cannot resize image /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Ensure instance console log exists: /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Successfully updated port: 178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquired lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-changed-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Refreshing instance network info cache due to event network-changed-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] Acquiring lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updating instance_info_cache with network_info: [{"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Releasing lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Instance network_info: |[{"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] Acquired lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Refreshing network info cache for port 178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Start _get_guest_xml network_info=[{"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:32:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:32:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995243802',display_name='tempest-AttachVolumeNegativeTest-server-1995243802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995243802',id=33,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODl99MKHt29o5kln8kZg4o5GLT0E/Qde1HkDvz4510nWA5Jb0FTsfYY2aA7FX4JLvcGh4ck0ZWnATep9p7wqkKHcxZ3u6o73SEFMHi33WvGB6zyxnTHgv0XehVj/iCX5g==',key_name='tempest-keypair-2133524706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-mcbx5zj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=b7149578-f4eb-4bff-ae81-b2dbec4d9e67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:43,bridge_name='br-int',has_traffic_filtering=True,id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178245a4-9c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'pci_devices' on Instance uuid b7149578-f4eb-4bff-ae81-b2dbec4d9e67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:32:59 user nova-compute[75071]:   <uuid>b7149578-f4eb-4bff-ae81-b2dbec4d9e67</uuid>
Nov 29 13:32:59 user nova-compute[75071]:   <name>instance-00000021</name>
Nov 29 13:32:59 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:32:59 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:32:59 user nova-compute[75071]:   <metadata>
Nov 29 13:32:59 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:32:59 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:32:59 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1995243802</nova:name>
Nov 29 13:32:59 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:32:59</nova:creationTime>
Nov 29 13:32:59 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:32:59 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:32:59 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:32:59 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:32:59 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:32:59 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:32:59 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:32:59 user nova-compute[75071]:       <nova:owner>
Nov 29 13:32:59 user nova-compute[75071]:         <nova:user uuid="350e0cf65eeb441582c203ac06668009">tempest-AttachVolumeNegativeTest-1996696047-project-member</nova:user>
Nov 29 13:32:59 user nova-compute[75071]:         <nova:project uuid="f9f00a9cd6fd4b4398314100706a720b">tempest-AttachVolumeNegativeTest-1996696047</nova:project>
Nov 29 13:32:59 user nova-compute[75071]:       </nova:owner>
Nov 29 13:32:59 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:32:59 user nova-compute[75071]:       <nova:ports>
Nov 29 13:32:59 user nova-compute[75071]:         <nova:port uuid="178245a4-9cc5-4c5c-82a7-6bcaa2aa7643">
Nov 29 13:32:59 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 13:32:59 user nova-compute[75071]:         </nova:port>
Nov 29 13:32:59 user nova-compute[75071]:       </nova:ports>
Nov 29 13:32:59 user nova-compute[75071]:     </nova:instance>
Nov 29 13:32:59 user nova-compute[75071]:   </metadata>
Nov 29 13:32:59 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:32:59 user nova-compute[75071]:     <system>
Nov 29 13:32:59 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:32:59 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:32:59 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:32:59 user nova-compute[75071]:       <entry name="serial">b7149578-f4eb-4bff-ae81-b2dbec4d9e67</entry>
Nov 29 13:32:59 user nova-compute[75071]:       <entry name="uuid">b7149578-f4eb-4bff-ae81-b2dbec4d9e67</entry>
Nov 29 13:32:59 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:32:59 user nova-compute[75071]:     </system>
Nov 29 13:32:59 user nova-compute[75071]:   </sysinfo>
Nov 29 13:32:59 user nova-compute[75071]:   <os>
Nov 29 13:32:59 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:32:59 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:32:59 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:32:59 user nova-compute[75071]:   </os>
Nov 29 13:32:59 user nova-compute[75071]:   <features>
Nov 29 13:32:59 user nova-compute[75071]:     <acpi/>
Nov 29 13:32:59 user nova-compute[75071]:     <apic/>
Nov 29 13:32:59 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:32:59 user nova-compute[75071]:   </features>
Nov 29 13:32:59 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:32:59 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:32:59 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:32:59 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:32:59 user nova-compute[75071]:   </clock>
Nov 29 13:32:59 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:32:59 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:32:59 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:32:59 user nova-compute[75071]:   </cpu>
Nov 29 13:32:59 user nova-compute[75071]:   <devices>
Nov 29 13:32:59 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:32:59 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:32:59 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk"/>
Nov 29 13:32:59 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:32:59 user nova-compute[75071]:     </disk>
Nov 29 13:32:59 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:32:59 user nova-compute[75071]:       <mac address="fa:16:3e:4f:77:43"/>
Nov 29 13:32:59 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:32:59 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:32:59 user nova-compute[75071]:       <target dev="tap178245a4-9c"/>
Nov 29 13:32:59 user nova-compute[75071]:     </interface>
Nov 29 13:32:59 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:32:59 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/console.log" append="off"/>
Nov 29 13:32:59 user nova-compute[75071]:     </serial>
Nov 29 13:32:59 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:32:59 user nova-compute[75071]:     <video>
Nov 29 13:32:59 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:32:59 user nova-compute[75071]:     </video>
Nov 29 13:32:59 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:32:59 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:32:59 user nova-compute[75071]:     </rng>
Nov 29 13:32:59 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:32:59 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:32:59 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:32:59 user nova-compute[75071]:     </memballoon>
Nov 29 13:32:59 user nova-compute[75071]:   </devices>
Nov 29 13:32:59 user nova-compute[75071]: </domain>
Nov 29 13:32:59 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995243802',display_name='tempest-AttachVolumeNegativeTest-server-1995243802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995243802',id=33,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODl99MKHt29o5kln8kZg4o5GLT0E/Qde1HkDvz4510nWA5Jb0FTsfYY2aA7FX4JLvcGh4ck0ZWnATep9p7wqkKHcxZ3u6o73SEFMHi33WvGB6zyxnTHgv0XehVj/iCX5g==',key_name='tempest-keypair-2133524706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-mcbx5zj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=b7149578-f4eb-4bff-ae81-b2dbec4d9e67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:43,bridge_name='br-int',has_traffic_filtering=True,id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178245a4-9c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG os_vif [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:43,bridge_name='br-int',has_traffic_filtering=True,id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178245a4-9c') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c742799-0764-526c-9799-190ad82b39b2', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap178245a4-9c, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap178245a4-9c, col_values=(('qos', UUID('728da802-be5e-45b1-a3e3-2ebbe162f00c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap178245a4-9c, col_values=(('external_ids', {'iface-id': '178245a4-9cc5-4c5c-82a7-6bcaa2aa7643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:77:43', 'vm-uuid': 'b7149578-f4eb-4bff-ae81-b2dbec4d9e67'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:32:59 user nova-compute[75071]: INFO os_vif [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:43,bridge_name='br-int',has_traffic_filtering=True,id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178245a4-9c')
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No VIF found with MAC fa:16:3e:4f:77:43, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updated VIF entry in instance network info cache for port 178245a4-9cc5-4c5c-82a7-6bcaa2aa7643. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updating instance_info_cache with network_info: [{"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-93cf0f4f-aa17-4c65-8af2-9ea6ef012abf req-9fb1a053-0c03-4e63-aee7-a6d69628c357 service nova] Releasing lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:33:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b is timed out.
Nov 29 13:33:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Successfully detached device vdb from instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b from the live domain config.
Nov 29 13:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPHDyGlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:33:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0852032-4d03-495c-a540-760a99fa0606]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:33:00 user nova-compute[75071]: No targets found.
Nov 29 13:33:00 user nova-compute[75071]: iSNS:
Nov 29 13:33:00 user nova-compute[75071]: No targets found.
Nov 29 13:33:00 user nova-compute[75071]: STATIC:
Nov 29 13:33:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7
Nov 29 13:33:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:33:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:33:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976
Nov 29 13:33:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:33:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:33:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:33:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:33:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:33:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:33:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:33:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:33:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:33:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:33:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:33:00 user nova-compute[75071]: FIRMWARE:
Nov 29 13:33:00 user nova-compute[75071]: No targets found.
Nov 29 13:33:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:33:00 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:33:00 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd292ed3-b772-487d-8ca2-7a329c07cdec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a2cb82-ca1c-47d3-9fbf-af763cd4a7dd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 (non-flash)
Nov 29 13:33:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148412680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b104d574-729c-4438-b88e-3b89da71c947]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f9b84b-25a8-45e1-a3d6-6117263f518c]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fb42a4-18cb-4682-b5f9-b6e1f7bb58cc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a987032d-4810-4cdf-aa29-b7033a9572d9]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d9d74-7f69-408e-b731-06240d0524d0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee79f94-4408-4af0-9c94-2ec200089ab0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260]
Nov 29 13:33:00 user nova-compute[75071]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976, portal: 172.16.0.220,3260] successful.
Nov 29 13:33:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aeefdda1-8ad4-4095-a789-f76c277fc976 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ddd730-23ad-4157-97ce-ab84a47af1bc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] <== disconnect_volume: return (321ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-5aeac500-e21f-4fce-a58b-8c2fbba54279 req-9f4551b3-82ae-4c78-b27f-11917929c999 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5aeac500-e21f-4fce-a58b-8c2fbba54279 req-9f4551b3-82ae-4c78-b27f-11917929c999 service nova] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5aeac500-e21f-4fce-a58b-8c2fbba54279 req-9f4551b3-82ae-4c78-b27f-11917929c999 service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5aeac500-e21f-4fce-a58b-8c2fbba54279 req-9f4551b3-82ae-4c78-b27f-11917929c999 service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-5aeac500-e21f-4fce-a58b-8c2fbba54279 req-9f4551b3-82ae-4c78-b27f-11917929c999 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] No waiting events found dispatching network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:33:00 user nova-compute[75071]: WARNING nova.compute.manager [req-5aeac500-e21f-4fce-a58b-8c2fbba54279 req-9f4551b3-82ae-4c78-b27f-11917929c999 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received unexpected event network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 for instance with vm_state building and task_state spawning.
Nov 29 13:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:33:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Instance spawned successfully.
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-dcd667cf-1052-419d-ad86-02633c078609 req-d0c447a6-41ef-4634-b953-210b1ae0e9ba service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dcd667cf-1052-419d-ad86-02633c078609 req-d0c447a6-41ef-4634-b953-210b1ae0e9ba service nova] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dcd667cf-1052-419d-ad86-02633c078609 req-d0c447a6-41ef-4634-b953-210b1ae0e9ba service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dcd667cf-1052-419d-ad86-02633c078609 req-d0c447a6-41ef-4634-b953-210b1ae0e9ba service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-dcd667cf-1052-419d-ad86-02633c078609 req-d0c447a6-41ef-4634-b953-210b1ae0e9ba service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] No waiting events found dispatching network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:33:02 user nova-compute[75071]: WARNING nova.compute.manager [req-dcd667cf-1052-419d-ad86-02633c078609 req-d0c447a6-41ef-4634-b953-210b1ae0e9ba service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received unexpected event network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 for instance with vm_state building and task_state spawning.
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lazy-loading 'flavor' on Instance uuid b3c8e702-1259-49c0-9a7f-b6d8877ffa2b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:33:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-edfa8367-ed6a-4b76-9b54-997a7d02e97c tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.357s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:02 user nova-compute[75071]: INFO nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 29 13:33:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:33:03 user nova-compute[75071]: INFO nova.compute.manager [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Took 6.47 seconds to build instance.
Nov 29 13:33:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4b10bc4-863a-4336-a959-196aa6033b90 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.588s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Going to confirm migration 2 {{(pid=75071) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquired lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'info_cache' on Instance uuid 08de871b-9fc3-4766-b32a-01d809a2d4c1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Releasing lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'migration_context' on Instance uuid 08de871b-9fc3-4766-b32a-01d809a2d4c1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG nova.objects.base [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Object Instance<08de871b-9fc3-4766-b32a-01d809a2d4c1> lazy-loaded attributes: info_cache,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:33:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:33:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.452s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:09 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Deleted allocation for migration 2114b760-fc94-4051-81e8-b9165d5cea83
Nov 29 13:33:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f21fb55f-e881-4325-a6e5-f4b83ba7b4bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.464s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:33:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:33:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:33:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:33:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:33:19 user nova-compute[75071]: INFO nova.compute.manager [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] instance snapshotting
Nov 29 13:33:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Beginning live snapshot process
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0tkt9vov/cba829c58a5c483487fdb55391238dcb.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0tkt9vov/cba829c58a5c483487fdb55391238dcb.delta 1073741824" returned: 0 in 0.052s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 13:33:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:33:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] COPY block job progress, current cursor: 17498112 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:33:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:33:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 13:33:22 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:33:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0tkt9vov/cba829c58a5c483487fdb55391238dcb.delta /opt/stack/data/nova/instances/snapshots/tmp0tkt9vov/cba829c58a5c483487fdb55391238dcb {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0tkt9vov/cba829c58a5c483487fdb55391238dcb.delta /opt/stack/data/nova/instances/snapshots/tmp0tkt9vov/cba829c58a5c483487fdb55391238dcb" returned: 0 in 0.592s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Snapshot extracted, beginning image upload
Nov 29 13:33:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Snapshot image upload complete
Nov 29 13:33:25 user nova-compute[75071]: INFO nova.compute.manager [None req-63793ea2-4f28-4672-b876-f5d3c0db2614 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Took 5.90 seconds to snapshot the instance on the hypervisor.
Nov 29 13:33:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-changed-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Refreshing instance network info cache due to event network-changed-f4114f62-6b07-4f02-9663-f1095f018f53. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:33:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] Acquiring lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:33:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] Acquired lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:33:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Refreshing network info cache for port f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:33:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updated VIF entry in instance network info cache for port f4114f62-6b07-4f02-9663-f1095f018f53. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:33:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updating instance_info_cache with network_info: [{"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:33:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-486bd61a-b380-40c4-b699-b639d52b9e5a req-219c670a-a2b3-4e3a-8684-0d74254c2150 service nova] Releasing lock "refresh_cache-b6ed42c9-2b8c-4f2a-930e-81ba854778be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:33:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:33 user nova-compute[75071]: INFO nova.compute.manager [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Terminating instance
Nov 29 13:33:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-0613f1ca-9ac0-4330-b950-08f173d96bb9 req-3af85719-5df0-4092-abbf-3a9f9ef0821e service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-vif-unplugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0613f1ca-9ac0-4330-b950-08f173d96bb9 req-3af85719-5df0-4092-abbf-3a9f9ef0821e service nova] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0613f1ca-9ac0-4330-b950-08f173d96bb9 req-3af85719-5df0-4092-abbf-3a9f9ef0821e service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0613f1ca-9ac0-4330-b950-08f173d96bb9 req-3af85719-5df0-4092-abbf-3a9f9ef0821e service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-0613f1ca-9ac0-4330-b950-08f173d96bb9 req-3af85719-5df0-4092-abbf-3a9f9ef0821e service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] No waiting events found dispatching network-vif-unplugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-0613f1ca-9ac0-4330-b950-08f173d96bb9 req-3af85719-5df0-4092-abbf-3a9f9ef0821e service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-vif-unplugged-b452f374-35e6-43b3-ae62-b144cf266758 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:33:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Instance destroyed successfully.
Nov 29 13:33:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lazy-loading 'resources' on Instance uuid b3c8e702-1259-49c0-9a7f-b6d8877ffa2b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:30:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-122808159',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-122808159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1228081',id=29,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6pkjNjf3K0OYIgzInIYh8kyr5U2+9blDoTN1Q8EhgIVBKneQkZdm/J7uqMLJW2OSHkuoHBb14/cP59V/DW57iRc9EmCLF2wSbqdmEnJKDzKiufcNiUOv1tNbxh2DZeIQ==',key_name='tempest-keypair-772556044',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='474e141ca43a458aa529a314e15f3ad4',ramdisk_id='',reservation_id='r-d9x0zfw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2024047258',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:30:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ab074edb904199b8568ef500ce91e1',uuid=b3c8e702-1259-49c0-9a7f-b6d8877ffa2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Converting VIF {"id": "b452f374-35e6-43b3-ae62-b144cf266758", "address": "fa:16:3e:38:2d:fc", "network": {"id": "093f05d5-f7cc-42f3-a423-f147428c06e6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-808513507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "474e141ca43a458aa529a314e15f3ad4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb452f374-35", "ovs_interfaceid": "b452f374-35e6-43b3-ae62-b144cf266758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:2d:fc,bridge_name='br-int',has_traffic_filtering=True,id=b452f374-35e6-43b3-ae62-b144cf266758,network=Network(093f05d5-f7cc-42f3-a423-f147428c06e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb452f374-35') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG os_vif [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2d:fc,bridge_name='br-int',has_traffic_filtering=True,id=b452f374-35e6-43b3-ae62-b144cf266758,network=Network(093f05d5-f7cc-42f3-a423-f147428c06e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb452f374-35') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb452f374-35, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ce066df-ad91-4c2c-9b11-b36f83120732) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:33:34 user nova-compute[75071]: INFO os_vif [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2d:fc,bridge_name='br-int',has_traffic_filtering=True,id=b452f374-35e6-43b3-ae62-b144cf266758,network=Network(093f05d5-f7cc-42f3-a423-f147428c06e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb452f374-35')
Nov 29 13:33:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Deleting instance files /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b_del
Nov 29 13:33:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Deletion of /opt/stack/data/nova/instances/b3c8e702-1259-49c0-9a7f-b6d8877ffa2b_del complete
Nov 29 13:33:34 user nova-compute[75071]: INFO nova.compute.manager [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 13:33:34 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:33:35 user nova-compute[75071]: INFO nova.compute.claims [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Claim successful on node user
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-0d5b53ab-1daf-4239-b1ea-dd0df39908f7 req-744b669a-6374-424c-a2fa-4eb86206450f service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-vif-deleted-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:35 user nova-compute[75071]: INFO nova.compute.manager [req-0d5b53ab-1daf-4239-b1ea-dd0df39908f7 req-744b669a-6374-424c-a2fa-4eb86206450f service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Neutron deleted interface b452f374-35e6-43b3-ae62-b144cf266758; detaching it from the instance and deleting it from the info cache
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-0d5b53ab-1daf-4239-b1ea-dd0df39908f7 req-744b669a-6374-424c-a2fa-4eb86206450f service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-30e3e8d2-921a-4143-830f-eb5bc5809a20 req-e8255f7c-4281-49ea-9d34-58901d523aac service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received event network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30e3e8d2-921a-4143-830f-eb5bc5809a20 req-e8255f7c-4281-49ea-9d34-58901d523aac service nova] Acquiring lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30e3e8d2-921a-4143-830f-eb5bc5809a20 req-e8255f7c-4281-49ea-9d34-58901d523aac service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30e3e8d2-921a-4143-830f-eb5bc5809a20 req-e8255f7c-4281-49ea-9d34-58901d523aac service nova] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-30e3e8d2-921a-4143-830f-eb5bc5809a20 req-e8255f7c-4281-49ea-9d34-58901d523aac service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] No waiting events found dispatching network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:33:35 user nova-compute[75071]: WARNING nova.compute.manager [req-30e3e8d2-921a-4143-830f-eb5bc5809a20 req-e8255f7c-4281-49ea-9d34-58901d523aac service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Received unexpected event network-vif-plugged-b452f374-35e6-43b3-ae62-b144cf266758 for instance with vm_state active and task_state deleting.
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-0d5b53ab-1daf-4239-b1ea-dd0df39908f7 req-744b669a-6374-424c-a2fa-4eb86206450f service nova] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Detach interface failed, port_id=b452f374-35e6-43b3-ae62-b144cf266758, reason: Instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:33:35 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: b3c8e702-1259-49c0-9a7f-b6d8877ffa2b] Took 1.41 seconds to deallocate network for instance.
Nov 29 13:33:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:35 user nova-compute[75071]: INFO nova.virt.block_device [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Booting with volume snapshot fda30cae-8965-4b6b-acc0-9f8bd3fa64ec at /dev/vda
Nov 29 13:33:35 user nova-compute[75071]: DEBUG nova.policy [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32b037a2bbef4090a2317bfeedd8e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b75ecae6764ce1801dbab6253ac6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:33:36 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:33:36 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:33:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:36 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Deleted allocations for instance b3c8e702-1259-49c0-9a7f-b6d8877ffa2b
Nov 29 13:33:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-eb859f32-aabb-4811-ac2f-c74eec03c114 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258 tempest-TestServerVolumeAttachScenarioOldVersion-2024047258-project-member] Lock "b3c8e702-1259-49c0-9a7f-b6d8877ffa2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.280s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Successfully created port: fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Successfully updated port: fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquired lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Updating instance_info_cache with network_info: [{"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Releasing lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Instance network_info: |[{"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-changed-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Refreshing instance network info cache due to event network-changed-fe25d636-0ef9-4ca7-a7a0-07e63b9315be. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] Acquiring lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] Acquired lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:33:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Refreshing network info cache for port fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:33:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Updated VIF entry in instance network info cache for port fe25d636-0ef9-4ca7-a7a0-07e63b9315be. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:33:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Updating instance_info_cache with network_info: [{"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:33:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f6acc13-14d2-4170-88d4-9be176bf216d req-13ee81e1-2fcf-4c7b-9fcb-f332eda9d3f7 service nova] Releasing lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:33:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:40 user nova-compute[75071]: INFO nova.compute.manager [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Detaching volume f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:33:40 user nova-compute[75071]: INFO nova.virt.block_device [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Attempting to driver detach volume f4b7c2d2-4b60-460b-902c-706d82921a39 from mountpoint /dev/vdb
Nov 29 13:33:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Attempting to detach device vdb from instance f9101862-4ab0-4973-84a7-411ab276084d from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:33:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:33:40 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:33:40 user nova-compute[75071]:   <source dev="/dev/sde"/>
Nov 29 13:33:40 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:33:40 user nova-compute[75071]:   <serial>f4b7c2d2-4b60-460b-902c-706d82921a39</serial>
Nov 29 13:33:40 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:33:40 user nova-compute[75071]: </disk>
Nov 29 13:33:40 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:33:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully detached device vdb from instance f9101862-4ab0-4973-84a7-411ab276084d from the persistent domain config.
Nov 29 13:33:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9101862-4ab0-4973-84a7-411ab276084d from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:33:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:33:40 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:33:40 user nova-compute[75071]:   <source dev="/dev/sde"/>
Nov 29 13:33:40 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:33:40 user nova-compute[75071]:   <serial>f4b7c2d2-4b60-460b-902c-706d82921a39</serial>
Nov 29 13:33:40 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 13:33:40 user nova-compute[75071]: </disk>
Nov 29 13:33:40 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5963657-af27-42f9-9758-d11491bb29ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d4a18-4025-45a2-9261-f3ae76388f2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8cd7f0-3730-4b57-bd71-4529b6c3033c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5824ef-a808-46bf-91ae-c7f499a6ab5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:33:41 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:33:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a4bb0a-7e58-4b2b-adb8-5bcc6ff58152]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:33:41 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Updating existing volume attachment record: 656bf026-45a5-41b3-a1af-4764254f2cfc {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:33:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:33:49 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Creating image(s)
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Ensure instance console log exists: /opt/stack/data/nova/instances/a3436722-b11d-4ea7-bb8e-239fe37cea51/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Start _get_guest_xml network_info=[{"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T13:33:29Z,direct_url=<?>,disk_format='qcow2',id=be6e3114-8d22-46dd-b0bd-bba6dfcc3ae7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-181924919',owner='86b75ecae6764ce1801dbab6253ac6c4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T13:33:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGJQVFnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3436722-b11d-4ea7-bb8e-239fe37cea51', 'attached_at': '', 'detached_at': '', 'volume_id': 'f39e81a0-692a-421b-908b-946fb5370d6e', 'serial': 'f39e81a0-692a-421b-908b-946fb5370d6e'}, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '656bf026-45a5-41b3-a1af-4764254f2cfc', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:33:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:33:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T13:33:29Z,direct_url=<?>,disk_format='qcow2',id=be6e3114-8d22-46dd-b0bd-bba6dfcc3ae7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-181924919',owner='86b75ecae6764ce1801dbab6253ac6c4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T13:33:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGJQVFnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:33:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:33:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:33:49 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47374e5-fc66-491f-82d3-61b20e3f551b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:33:49 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ae5e22-6fdc-406b-b15f-0c450314f3bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e] added
Nov 29 13:33:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2303c1d5-4498-475f-909f-edcb42f112a6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[92818124-d47d-476a-a4b9-c014a93bc81a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGJQVFnp {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGJQVFnp" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a961d-bc8f-4e5d-bd12-805d4c9d5f2a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGJQVFnp'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daaae62-da81-47c3-b40c-72d9f66727c5]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daa5c3a-fb93-4016-a50f-19652366a32f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[816fd4b8-d64c-4267-a529-795e34e52e27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260]
Nov 29 13:33:49 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260] successful.
Nov 29 13:33:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a651dda6-8ef2-412f-8032-1374127e02c7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd29f720-eb39-48aa-889e-e65fc02ed659]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:33:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:33:49 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:33:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a133973-5a76-4247-855d-feee33fad5d0]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:33:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:33:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGJQVFnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:33:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:33:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23864646561363135', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:33:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864646561363135', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-885511432',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-885511432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-885511432',id=34,image_ref='be6e3114-8d22-46dd-b0bd-bba6dfcc3ae7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTZpedBhadVENsYZrHEjW/L/svkXHRIu14WHGXmqvCCI12+X7zTm6vS8ALByKLQHcBpuBPvyG1aKy6CGAPKbOGTfwA1OOMGfxt3lxYj0vQiboIgCVPLOk6wzpNZ3Ugg3A==',key_name='tempest-keypair-323962342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-r9rmq93m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2055293783',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=a3436722-b11d-4ea7-bb8e-239fe37cea51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d8:60,bridge_name='br-int',has_traffic_filtering=True,id=fe25d636-0ef9-4ca7-a7a0-07e63b9315be,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe25d636-0e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'pci_devices' on Instance uuid a3436722-b11d-4ea7-bb8e-239fe37cea51 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:33:51 user nova-compute[75071]:   <uuid>a3436722-b11d-4ea7-bb8e-239fe37cea51</uuid>
Nov 29 13:33:51 user nova-compute[75071]:   <name>instance-00000022</name>
Nov 29 13:33:51 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:33:51 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:33:51 user nova-compute[75071]:   <metadata>
Nov 29 13:33:51 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:33:51 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:33:51 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-885511432</nova:name>
Nov 29 13:33:51 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:33:49</nova:creationTime>
Nov 29 13:33:51 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:33:51 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:33:51 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:33:51 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:33:51 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:33:51 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:33:51 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:33:51 user nova-compute[75071]:       <nova:owner>
Nov 29 13:33:51 user nova-compute[75071]:         <nova:user uuid="32b037a2bbef4090a2317bfeedd8e155">tempest-TestVolumeBootPattern-2055293783-project-member</nova:user>
Nov 29 13:33:51 user nova-compute[75071]:         <nova:project uuid="86b75ecae6764ce1801dbab6253ac6c4">tempest-TestVolumeBootPattern-2055293783</nova:project>
Nov 29 13:33:51 user nova-compute[75071]:       </nova:owner>
Nov 29 13:33:51 user nova-compute[75071]:       <nova:root type="image" uuid="be6e3114-8d22-46dd-b0bd-bba6dfcc3ae7"/>
Nov 29 13:33:51 user nova-compute[75071]:       <nova:ports>
Nov 29 13:33:51 user nova-compute[75071]:         <nova:port uuid="fe25d636-0ef9-4ca7-a7a0-07e63b9315be">
Nov 29 13:33:51 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 13:33:51 user nova-compute[75071]:         </nova:port>
Nov 29 13:33:51 user nova-compute[75071]:       </nova:ports>
Nov 29 13:33:51 user nova-compute[75071]:     </nova:instance>
Nov 29 13:33:51 user nova-compute[75071]:   </metadata>
Nov 29 13:33:51 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:33:51 user nova-compute[75071]:     <system>
Nov 29 13:33:51 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:33:51 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:33:51 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:33:51 user nova-compute[75071]:       <entry name="serial">a3436722-b11d-4ea7-bb8e-239fe37cea51</entry>
Nov 29 13:33:51 user nova-compute[75071]:       <entry name="uuid">a3436722-b11d-4ea7-bb8e-239fe37cea51</entry>
Nov 29 13:33:51 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:33:51 user nova-compute[75071]:     </system>
Nov 29 13:33:51 user nova-compute[75071]:   </sysinfo>
Nov 29 13:33:51 user nova-compute[75071]:   <os>
Nov 29 13:33:51 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:33:51 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:33:51 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:33:51 user nova-compute[75071]:   </os>
Nov 29 13:33:51 user nova-compute[75071]:   <features>
Nov 29 13:33:51 user nova-compute[75071]:     <acpi/>
Nov 29 13:33:51 user nova-compute[75071]:     <apic/>
Nov 29 13:33:51 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:33:51 user nova-compute[75071]:   </features>
Nov 29 13:33:51 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:33:51 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:33:51 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:33:51 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:33:51 user nova-compute[75071]:   </clock>
Nov 29 13:33:51 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:33:51 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:33:51 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:33:51 user nova-compute[75071]:   </cpu>
Nov 29 13:33:51 user nova-compute[75071]:   <devices>
Nov 29 13:33:51 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:33:51 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:33:51 user nova-compute[75071]:       <source dev="/dev/sdf"/>
Nov 29 13:33:51 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:33:51 user nova-compute[75071]:       <serial>f39e81a0-692a-421b-908b-946fb5370d6e</serial>
Nov 29 13:33:51 user nova-compute[75071]:     </disk>
Nov 29 13:33:51 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:33:51 user nova-compute[75071]:       <mac address="fa:16:3e:7f:d8:60"/>
Nov 29 13:33:51 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:33:51 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:33:51 user nova-compute[75071]:       <target dev="tapfe25d636-0e"/>
Nov 29 13:33:51 user nova-compute[75071]:     </interface>
Nov 29 13:33:51 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:33:51 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/a3436722-b11d-4ea7-bb8e-239fe37cea51/console.log" append="off"/>
Nov 29 13:33:51 user nova-compute[75071]:     </serial>
Nov 29 13:33:51 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:33:51 user nova-compute[75071]:     <video>
Nov 29 13:33:51 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:33:51 user nova-compute[75071]:     </video>
Nov 29 13:33:51 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:33:51 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:33:51 user nova-compute[75071]:     </rng>
Nov 29 13:33:51 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:33:51 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:33:51 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:33:51 user nova-compute[75071]:     </memballoon>
Nov 29 13:33:51 user nova-compute[75071]:   </devices>
Nov 29 13:33:51 user nova-compute[75071]: </domain>
Nov 29 13:33:51 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-885511432',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-885511432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-885511432',id=34,image_ref='be6e3114-8d22-46dd-b0bd-bba6dfcc3ae7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTZpedBhadVENsYZrHEjW/L/svkXHRIu14WHGXmqvCCI12+X7zTm6vS8ALByKLQHcBpuBPvyG1aKy6CGAPKbOGTfwA1OOMGfxt3lxYj0vQiboIgCVPLOk6wzpNZ3Ugg3A==',key_name='tempest-keypair-323962342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-r9rmq93m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2055293783',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=a3436722-b11d-4ea7-bb8e-239fe37cea51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d8:60,bridge_name='br-int',has_traffic_filtering=True,id=fe25d636-0ef9-4ca7-a7a0-07e63b9315be,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe25d636-0e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG os_vif [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d8:60,bridge_name='br-int',has_traffic_filtering=True,id=fe25d636-0ef9-4ca7-a7a0-07e63b9315be,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe25d636-0e') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ec01311-28a1-5a26-973c-a96c95f66a51', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe25d636-0e, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe25d636-0e, col_values=(('qos', UUID('aa0129db-5497-48b6-a343-01640517ee81')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe25d636-0e, col_values=(('external_ids', {'iface-id': 'fe25d636-0ef9-4ca7-a7a0-07e63b9315be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:d8:60', 'vm-uuid': 'a3436722-b11d-4ea7-bb8e-239fe37cea51'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:51 user nova-compute[75071]: INFO os_vif [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:d8:60,bridge_name='br-int',has_traffic_filtering=True,id=fe25d636-0ef9-4ca7-a7a0-07e63b9315be,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe25d636-0e')
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No VIF found with MAC fa:16:3e:7f:d8:60, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:33:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4f65102-a83c-4184-806b-4e8f52dc2afe req-367e8b36-4b4f-493c-9bcd-6ef393643d1e service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4f65102-a83c-4184-806b-4e8f52dc2afe req-367e8b36-4b4f-493c-9bcd-6ef393643d1e service nova] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4f65102-a83c-4184-806b-4e8f52dc2afe req-367e8b36-4b4f-493c-9bcd-6ef393643d1e service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4f65102-a83c-4184-806b-4e8f52dc2afe req-367e8b36-4b4f-493c-9bcd-6ef393643d1e service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4f65102-a83c-4184-806b-4e8f52dc2afe req-367e8b36-4b4f-493c-9bcd-6ef393643d1e service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] No waiting events found dispatching network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:33:52 user nova-compute[75071]: WARNING nova.compute.manager [req-d4f65102-a83c-4184-806b-4e8f52dc2afe req-367e8b36-4b4f-493c-9bcd-6ef393643d1e service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received unexpected event network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be for instance with vm_state building and task_state spawning.
Nov 29 13:33:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:33:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Instance spawned successfully.
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:33:54 user nova-compute[75071]: INFO nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:54 user nova-compute[75071]: INFO nova.compute.manager [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Took 19.60 seconds to build instance.
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-763117cf-0a5a-470b-8384-ad249ec9e133 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.723s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-5073722e-08a8-4b94-b30b-c71e29282a93 req-c777fd72-8355-46db-9a37-82d1c39382bd service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5073722e-08a8-4b94-b30b-c71e29282a93 req-c777fd72-8355-46db-9a37-82d1c39382bd service nova] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5073722e-08a8-4b94-b30b-c71e29282a93 req-c777fd72-8355-46db-9a37-82d1c39382bd service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5073722e-08a8-4b94-b30b-c71e29282a93 req-c777fd72-8355-46db-9a37-82d1c39382bd service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-5073722e-08a8-4b94-b30b-c71e29282a93 req-c777fd72-8355-46db-9a37-82d1c39382bd service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] No waiting events found dispatching network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:33:54 user nova-compute[75071]: WARNING nova.compute.manager [req-5073722e-08a8-4b94-b30b-c71e29282a93 req-c777fd72-8355-46db-9a37-82d1c39382bd service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received unexpected event network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be for instance with vm_state active and task_state None.
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:33:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:33:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7767MB free_disk=24.998680114746094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b6ed42c9-2b8c-4f2a-930e-81ba854778be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9f62ede8-a1ed-411a-9720-b187674f974f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a3436722-b11d-4ea7-bb8e-239fe37cea51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:33:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.776s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:33:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [{"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-08de871b-9fc3-4766-b32a-01d809a2d4c1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:33:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9101862-4ab0-4973-84a7-411ab276084d is timed out.
Nov 29 13:34:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully detached device vdb from instance f9101862-4ab0-4973-84a7-411ab276084d from the live domain config.
Nov 29 13:34:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BGkOXpse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:34:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c1a971-b96e-4630-85ab-b78860f58ac6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:34:01 user nova-compute[75071]: No targets found.
Nov 29 13:34:01 user nova-compute[75071]: iSNS:
Nov 29 13:34:01 user nova-compute[75071]: No targets found.
Nov 29 13:34:01 user nova-compute[75071]: STATIC:
Nov 29 13:34:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e
Nov 29 13:34:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:34:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:34:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7
Nov 29 13:34:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:34:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:34:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39
Nov 29 13:34:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:34:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:34:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:34:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:34:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:34:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:34:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:34:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:34:01 user nova-compute[75071]: FIRMWARE:
Nov 29 13:34:01 user nova-compute[75071]: No targets found.
Nov 29 13:34:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:34:01 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:34:01 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc28e62-7411-4475-9fc1-7de31ab8c226]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aed95c-37ae-4184-8386-48eadd72fbb6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 (non-flash)
Nov 29 13:34:01 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f21486ed360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b0766-fbc1-4e65-bf40-56ed14f75427]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b49188-1a94-4bda-a0f7-5cdf070ee954]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2995b5-91b8-4bc6-885e-c6c02afd8d2f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[569ec20d-9547-4ed5-8bac-63522465f715]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb9db8-8593-47a2-b0c6-761b116cee15]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18dc390-8217-4638-9b46-16f846ccd5c8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260]
Nov 29 13:34:01 user nova-compute[75071]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39, portal: 172.16.0.220,3260] successful.
Nov 29 13:34:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b7c2d2-4b60-460b-902c-706d82921a39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b411384-13fc-4f49-8e6d-336f3fdef457]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== disconnect_volume: return (320ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:34:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:34:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:34:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-78f04782-a804-4663-85ca-898daef9dffd tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.131s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c245eb31-21dd-4db9-9d5c-aef63b425578 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c245eb31-21dd-4db9-9d5c-aef63b425578 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c245eb31-21dd-4db9-9d5c-aef63b425578 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c245eb31-21dd-4db9-9d5c-aef63b425578 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75071) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c245eb31-21dd-4db9-9d5c-aef63b425578 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e75dbf7-8de8-426a-97b0-f20b3b428702 req-e25a97cc-9183-4987-a034-bd1e22f69cdf service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e75dbf7-8de8-426a-97b0-f20b3b428702 req-e25a97cc-9183-4987-a034-bd1e22f69cdf service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e75dbf7-8de8-426a-97b0-f20b3b428702 req-e25a97cc-9183-4987-a034-bd1e22f69cdf service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e75dbf7-8de8-426a-97b0-f20b3b428702 req-e25a97cc-9183-4987-a034-bd1e22f69cdf service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e75dbf7-8de8-426a-97b0-f20b3b428702 req-e25a97cc-9183-4987-a034-bd1e22f69cdf service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:03 user nova-compute[75071]: WARNING nova.compute.manager [req-3e75dbf7-8de8-426a-97b0-f20b3b428702 req-e25a97cc-9183-4987-a034-bd1e22f69cdf service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state active and task_state powering-off.
Nov 29 13:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance destroyed successfully.
Nov 29 13:34:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c245eb31-21dd-4db9-9d5c-aef63b425578 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c245eb31-21dd-4db9-9d5c-aef63b425578 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.863s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:05 user nova-compute[75071]: WARNING nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state None.
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:05 user nova-compute[75071]: WARNING nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state None.
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:05 user nova-compute[75071]: WARNING nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state None.
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:05 user nova-compute[75071]: WARNING nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state None.
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:05 user nova-compute[75071]: WARNING nova.compute.manager [req-7e18327b-09c2-4d46-a526-fcac31cf7c5d req-75462a28-ba5c-412d-96b2-bf379d9cd1fb service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state None.
Nov 29 13:34:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing instance network info cache due to event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] Acquiring lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] Acquired lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updated VIF entry in instance network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3074d869-172b-422a-9dc4-7076f05450db req-e93da12d-26a0-4eb2-8870-f964d1cfe213 service nova] Releasing lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:25 user nova-compute[75071]: INFO nova.compute.manager [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Shelving
Nov 29 13:34:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-b5bef905-7b78-49c6-8280-81e89e95bb70 req-1e6f7479-9662-4a7b-9071-38a8b6eefee6 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-unplugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b5bef905-7b78-49c6-8280-81e89e95bb70 req-1e6f7479-9662-4a7b-9071-38a8b6eefee6 service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b5bef905-7b78-49c6-8280-81e89e95bb70 req-1e6f7479-9662-4a7b-9071-38a8b6eefee6 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b5bef905-7b78-49c6-8280-81e89e95bb70 req-1e6f7479-9662-4a7b-9071-38a8b6eefee6 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-b5bef905-7b78-49c6-8280-81e89e95bb70 req-1e6f7479-9662-4a7b-9071-38a8b6eefee6 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-unplugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:26 user nova-compute[75071]: WARNING nova.compute.manager [req-b5bef905-7b78-49c6-8280-81e89e95bb70 req-1e6f7479-9662-4a7b-9071-38a8b6eefee6 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received unexpected event network-vif-unplugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with vm_state active and task_state shelving.
Nov 29 13:34:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance destroyed successfully.
Nov 29 13:34:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Beginning cold snapshot process
Nov 29 13:34:26 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk /opt/stack/data/nova/instances/snapshots/tmpzc7yjfvl/b7bc994c1c864e77b2fddf59a1a83b57 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk /opt/stack/data/nova/instances/snapshots/tmpzc7yjfvl/b7bc994c1c864e77b2fddf59a1a83b57" returned: 0 in 0.999s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Snapshot extracted, beginning image upload
Nov 29 13:34:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:34:28 user nova-compute[75071]: INFO nova.compute.claims [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Claim successful on node user
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-203bd8f1-2f3d-43b5-877a-b4a5273982aa req-3f82d50f-aa33-4a1d-b909-ba91e455d8f1 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-203bd8f1-2f3d-43b5-877a-b4a5273982aa req-3f82d50f-aa33-4a1d-b909-ba91e455d8f1 service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-203bd8f1-2f3d-43b5-877a-b4a5273982aa req-3f82d50f-aa33-4a1d-b909-ba91e455d8f1 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-203bd8f1-2f3d-43b5-877a-b4a5273982aa req-3f82d50f-aa33-4a1d-b909-ba91e455d8f1 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-203bd8f1-2f3d-43b5-877a-b4a5273982aa req-3f82d50f-aa33-4a1d-b909-ba91e455d8f1 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:28 user nova-compute[75071]: WARNING nova.compute.manager [req-203bd8f1-2f3d-43b5-877a-b4a5273982aa req-3f82d50f-aa33-4a1d-b909-ba91e455d8f1 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received unexpected event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:34:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:34:28 user nova-compute[75071]: INFO nova.virt.block_device [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Booting with volume-backed-image 794347ff-8cf3-49d9-8652-9f89337799af at /dev/vda
Nov 29 13:34:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:28 user nova-compute[75071]: DEBUG nova.policy [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f902428dcca045ffa81dbd8fd53048b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd1e8292884439b8d49dd698bf812e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:34:29 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Successfully created port: 8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Successfully updated port: 8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-changed-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Refreshing instance network info cache due to event network-changed-8a52ed97-212a-42ce-9462-843bda80dfa0. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] Acquiring lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:34:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Snapshot image upload complete
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:34:30 user nova-compute[75071]: INFO nova.compute.manager [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Shelve offloading
Nov 29 13:34:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance destroyed successfully.
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquired lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updating instance_info_cache with network_info: [{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance network_info: |[{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] Acquired lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:34:30 user nova-compute[75071]: DEBUG nova.network.neutron [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Refreshing network info cache for port 8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updated VIF entry in instance network info cache for port 8a52ed97-212a-42ce-9462-843bda80dfa0. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updating instance_info_cache with network_info: [{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed926f9e-60a2-4bca-a04b-cdafe53bdab1 req-53d5ccf7-99cf-4ecd-a0e7-3affbb46537d service nova] Releasing lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Releasing lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:34:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance destroyed successfully.
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'resources' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-468125726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-468125726',id=32,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnEvpwLVwhA6iy3tz3v3R0fiS+WPfBzsMVdWoYBaM9OSMZpIjrwyYVB6spM1rKu3nJ13UulkADDc7mLe20T6IE6LPZD26bH00I8jG21iN2Y4DIO4RBD8jJ5Jb70bo8+A==',key_name='tempest-keypair-1169509056',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:32:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-7ikhq3le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member',shelved_at='2023-11-29T13:34:30.367637',shelved_host='user',shelved_image_id='d2097cb5-9a77-45fb-a4df-c3014195356f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:34:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=9f62ede8-a1ed-411a-9720-b187674f974f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG os_vif [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a523b75-f9, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59a7f563-5d64-4c5d-b408-bbc9651ecb28) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:31 user nova-compute[75071]: INFO os_vif [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9')
Nov 29 13:34:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Deleting instance files /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f_del
Nov 29 13:34:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Deletion of /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f_del complete
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing instance network info cache due to event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] Acquiring lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] Acquired lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:34:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:34:32 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Deleted allocations for instance 9f62ede8-a1ed-411a-9720-b187674f974f
Nov 29 13:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG nova.objects.base [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<9f62ede8-a1ed-411a-9720-b187674f974f> lazy-loaded attributes: resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updated VIF entry in instance network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8a523b75-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f2119690-7003-47a8-b6dc-a5730b6a7538 req-a26e90ea-c375-4c8d-b8f8-c601b92c297b service nova] Releasing lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-deb43cb8-136d-46f6-ae2d-cc31f22304e8 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.944s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG os_brick.utils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8655c-fd53-41af-a4c6-e9e30fa59d7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29e2413-0e98-48c6-b75a-7d9b13a0ac51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.109s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647f7f5-0eb6-47b6-8b05-e544a0f38f9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[987b59c0-0d2a-46b4-bce3-a1abe7bd3daa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:34:34 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:34:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3551d0ca-1200-4f48-b643-b4181117f11f]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG os_brick.utils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:34:34 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updating existing volume attachment record: 5bf3616a-56aa-4875-a026-1196de26118e {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:36 user nova-compute[75071]: WARNING nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 64806dd7-0adb-4bb2-954a-707928115ce9 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid a0bdb312-835a-499a-af02-58f5f25f50e9 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 08de871b-9fc3-4766-b32a-01d809a2d4c1 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid fcb58221-096b-4275-874f-efb5043b610b {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid b6ed42c9-2b8c-4f2a-930e-81ba854778be {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid b7149578-f4eb-4bff-ae81-b2dbec4d9e67 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid a3436722-b11d-4ea7-bb8e-239fe37cea51 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "fcb58221-096b-4275-874f-efb5043b610b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "fcb58221-096b-4275-874f-efb5043b610b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:34:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Creating image(s)
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Ensure instance console log exists: /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Start _get_guest_xml network_info=[{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAHiDyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a2550b8-269a-4cfb-887b-a3f3745812a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f230d135-cd25-43ac-a400-03ebd6fd03fb', 'serial': 'f230d135-cd25-43ac-a400-03ebd6fd03fb'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '5bf3616a-56aa-4875-a026-1196de26118e', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:34:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:34:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAHiDyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:34:42 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:34:42 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:34:42 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f57b214-cd75-41e3-950a-089294793da0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:34:42 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d2c865-cb7a-463b-a673-f45dda283d13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb] added
Nov 29 13:34:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5f2b7-bb83-4d47-bf22-1b5d614f0cad]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66e320-7b75-4ab7-a6f3-1e7a5403191c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAHiDyof {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAHiDyof" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[560fa8d1-ec77-436e-8d1d-2db13219b120]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAHiDyof'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6090f9ba-1195-44c5-a94e-75d4560e1570]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4736af5-bed7-4b59-bb55-6e30a2a61c71]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:42 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:42 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:42 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:42 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:42 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:42 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b880d221-bad2-4f32-b40d-d3ed84479dd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260]
Nov 29 13:34:42 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260] successful.
Nov 29 13:34:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14d533b-dcae-43a0-8e10-9cced36339c1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[848e5b7f-50ca-4e85-94f6-8ad9489009d6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:34:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:43 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:34:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a958f87-5ae5-4e89-98b7-c541ab432edc]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:34:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAHiDyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26266396436626366', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266396436626366', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836993308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836993308',id=35,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-hnur9bum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:34:29Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=6a2550b8-269a-4cfb-887b-a3f3745812a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:34:44 user nova-compute[75071]:   <uuid>6a2550b8-269a-4cfb-887b-a3f3745812a1</uuid>
Nov 29 13:34:44 user nova-compute[75071]:   <name>instance-00000023</name>
Nov 29 13:34:44 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:34:44 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:34:44 user nova-compute[75071]:   <metadata>
Nov 29 13:34:44 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:34:44 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:34:44 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-836993308</nova:name>
Nov 29 13:34:44 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:34:42</nova:creationTime>
Nov 29 13:34:44 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:34:44 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:34:44 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:34:44 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:34:44 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:34:44 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:34:44 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:34:44 user nova-compute[75071]:       <nova:owner>
Nov 29 13:34:44 user nova-compute[75071]:         <nova:user uuid="f902428dcca045ffa81dbd8fd53048b6">tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member</nova:user>
Nov 29 13:34:44 user nova-compute[75071]:         <nova:project uuid="ecd1e8292884439b8d49dd698bf812e1">tempest-ServerBootFromVolumeStableRescueTest-398011867</nova:project>
Nov 29 13:34:44 user nova-compute[75071]:       </nova:owner>
Nov 29 13:34:44 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:34:44 user nova-compute[75071]:       <nova:ports>
Nov 29 13:34:44 user nova-compute[75071]:         <nova:port uuid="8a52ed97-212a-42ce-9462-843bda80dfa0">
Nov 29 13:34:44 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 13:34:44 user nova-compute[75071]:         </nova:port>
Nov 29 13:34:44 user nova-compute[75071]:       </nova:ports>
Nov 29 13:34:44 user nova-compute[75071]:     </nova:instance>
Nov 29 13:34:44 user nova-compute[75071]:   </metadata>
Nov 29 13:34:44 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:34:44 user nova-compute[75071]:     <system>
Nov 29 13:34:44 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:34:44 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:34:44 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:34:44 user nova-compute[75071]:       <entry name="serial">6a2550b8-269a-4cfb-887b-a3f3745812a1</entry>
Nov 29 13:34:44 user nova-compute[75071]:       <entry name="uuid">6a2550b8-269a-4cfb-887b-a3f3745812a1</entry>
Nov 29 13:34:44 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:34:44 user nova-compute[75071]:     </system>
Nov 29 13:34:44 user nova-compute[75071]:   </sysinfo>
Nov 29 13:34:44 user nova-compute[75071]:   <os>
Nov 29 13:34:44 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:34:44 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:34:44 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:34:44 user nova-compute[75071]:   </os>
Nov 29 13:34:44 user nova-compute[75071]:   <features>
Nov 29 13:34:44 user nova-compute[75071]:     <acpi/>
Nov 29 13:34:44 user nova-compute[75071]:     <apic/>
Nov 29 13:34:44 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:34:44 user nova-compute[75071]:   </features>
Nov 29 13:34:44 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:34:44 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:34:44 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:34:44 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:34:44 user nova-compute[75071]:   </clock>
Nov 29 13:34:44 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:34:44 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:34:44 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:34:44 user nova-compute[75071]:   </cpu>
Nov 29 13:34:44 user nova-compute[75071]:   <devices>
Nov 29 13:34:44 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:34:44 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:34:44 user nova-compute[75071]:       <source dev="/dev/sde"/>
Nov 29 13:34:44 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:34:44 user nova-compute[75071]:       <serial>f230d135-cd25-43ac-a400-03ebd6fd03fb</serial>
Nov 29 13:34:44 user nova-compute[75071]:     </disk>
Nov 29 13:34:44 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:34:44 user nova-compute[75071]:       <mac address="fa:16:3e:4d:19:86"/>
Nov 29 13:34:44 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:34:44 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:34:44 user nova-compute[75071]:       <target dev="tap8a52ed97-21"/>
Nov 29 13:34:44 user nova-compute[75071]:     </interface>
Nov 29 13:34:44 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:34:44 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/console.log" append="off"/>
Nov 29 13:34:44 user nova-compute[75071]:     </serial>
Nov 29 13:34:44 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:34:44 user nova-compute[75071]:     <video>
Nov 29 13:34:44 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:34:44 user nova-compute[75071]:     </video>
Nov 29 13:34:44 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:34:44 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:34:44 user nova-compute[75071]:     </rng>
Nov 29 13:34:44 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:34:44 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:34:44 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:34:44 user nova-compute[75071]:     </memballoon>
Nov 29 13:34:44 user nova-compute[75071]:   </devices>
Nov 29 13:34:44 user nova-compute[75071]: </domain>
Nov 29 13:34:44 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836993308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836993308',id=35,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-hnur9bum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:34:29Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=6a2550b8-269a-4cfb-887b-a3f3745812a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG os_vif [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c3266f1-7298-51a6-8b64-4006788adeb8', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a52ed97-21, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a52ed97-21, col_values=(('qos', UUID('37eda0c3-d5e2-4353-bee1-c0661c100100')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a52ed97-21, col_values=(('external_ids', {'iface-id': '8a52ed97-212a-42ce-9462-843bda80dfa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:19:86', 'vm-uuid': '6a2550b8-269a-4cfb-887b-a3f3745812a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:44 user nova-compute[75071]: INFO os_vif [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21')
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:34:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No VIF found with MAC fa:16:3e:4d:19:86, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-91b6a5c7-7af6-4172-95e2-1b027d5750cf req-869826a8-0dae-4289-961e-2de0923919ba service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91b6a5c7-7af6-4172-95e2-1b027d5750cf req-869826a8-0dae-4289-961e-2de0923919ba service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91b6a5c7-7af6-4172-95e2-1b027d5750cf req-869826a8-0dae-4289-961e-2de0923919ba service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91b6a5c7-7af6-4172-95e2-1b027d5750cf req-869826a8-0dae-4289-961e-2de0923919ba service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-91b6a5c7-7af6-4172-95e2-1b027d5750cf req-869826a8-0dae-4289-961e-2de0923919ba service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:45 user nova-compute[75071]: WARNING nova.compute.manager [req-91b6a5c7-7af6-4172-95e2-1b027d5750cf req-869826a8-0dae-4289-961e-2de0923919ba service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state building and task_state spawning.
Nov 29 13:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:34:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance spawned successfully.
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:34:47 user nova-compute[75071]: WARNING nova.compute.manager [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state building and task_state spawning.
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-changed-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Refreshing instance network info cache due to event network-changed-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] Acquiring lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] Acquired lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Refreshing network info cache for port 178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:34:47 user nova-compute[75071]: INFO nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 29 13:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:34:47 user nova-compute[75071]: INFO nova.compute.manager [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Took 19.73 seconds to build instance.
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4a17ddc5-5e36-4103-bb20-d9c41d27af69 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.836s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.053s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:47 user nova-compute[75071]: INFO nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 29 13:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updated VIF entry in instance network info cache for port 178245a4-9cc5-4c5c-82a7-6bcaa2aa7643. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:34:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updating instance_info_cache with network_info: [{"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:34:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff358fd0-7073-4aa0-b078-1b41daff937c req-bafd65ff-3390-4ccc-9e47-1fbc1431fe13 service nova] Releasing lock "refresh_cache-b7149578-f4eb-4bff-ae81-b2dbec4d9e67" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:34:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:34:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid b7149578-f4eb-4bff-ae81-b2dbec4d9e67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:50 user nova-compute[75071]: INFO nova.compute.manager [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Attaching volume 493ad899-e7e4-444b-a537-747a7badd313 to /dev/vdb
Nov 29 13:34:50 user nova-compute[75071]: DEBUG os_brick.utils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de31db64-aa6a-4ce3-8d08-0b73b260d9c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd70564-d3a3-4519-81ea-b815ace4d853]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd8444-1acc-4f37-adba-d4120a9bffc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c44a156-a024-45a8-873f-b992c2ce9190]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:34:50 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d5c24e-85ef-40ac-9a03-c1c7fedbc5ad]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG os_brick.utils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updating existing volume attachment record: 63e9bc0c-bbc0-4c69-9d1f-56a494331d98 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:34:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:34:55 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:34:55 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8022MB free_disk=24.9742431640625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b6ed42c9-2b8c-4f2a-930e-81ba854778be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a3436722-b11d-4ea7-bb8e-239fe37cea51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6a2550b8-269a-4cfb-887b-a3f3745812a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:34:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:34:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:34:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnksNPUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:34:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:34:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:34:58 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52c372d-1946-4009-bbd5-c99e0d5a4fa3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:34:58 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5389e65f-8bf8-48ab-937b-441c82163771]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313] added
Nov 29 13:34:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d2e547-cc3e-47d4-838b-ec82d74cf554]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb65241-79cf-4b86-adbc-56ec04d54418]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KnksNPUG {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KnksNPUG" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f1f27-ef01-4e7f-bbee-c2cd27f62cf0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KnksNPUG'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb19b6-de8c-4a9e-b4d4-5961c249e72a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69dccd-7c4e-4b07-98dd-4139037d1762]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:34:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:34:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f9f7c9-4ff1-4dcd-91e4-4689f9e0f528]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260]
Nov 29 13:34:58 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260] successful.
Nov 29 13:34:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34149b7-067b-4a62-a26b-d8c4a7ca0b25]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feb46a4-73b0-46bb-98ed-2bd0c0df4048]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:34:58 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 (non-flash)
Nov 29 13:34:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[261c1e3c-e492-4a64-a03c-023b05f3fc83]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:34:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnksNPUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:34:59 user nova-compute[75071]: INFO nova.compute.manager [None req-8ecc5b1d-ea2c-4f14-b5be-6ce3f54a68bb tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Get console output
Nov 29 13:34:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:34:59 user nova-compute[75071]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 13:34:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:34:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23339306337316632', 'path': '/dev/sdg'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:34:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339306337316632', 'path': '/dev/sdg'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:34:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid b7149578-f4eb-4bff-ae81-b2dbec4d9e67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:34:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:34:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:34:59 user nova-compute[75071]:   <source dev="/dev/sdg"/>
Nov 29 13:34:59 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:34:59 user nova-compute[75071]:   <serial>493ad899-e7e4-444b-a537-747a7badd313</serial>
Nov 29 13:34:59 user nova-compute[75071]: </disk>
Nov 29 13:34:59 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:35:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:35:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:35:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] No VIF found with MAC fa:16:3e:4f:77:43, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:35:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3d0c05ff-771e-40df-9a4f-d0277273832c tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.951s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:01 user nova-compute[75071]: INFO nova.compute.manager [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Detaching volume 493ad899-e7e4-444b-a537-747a7badd313
Nov 29 13:35:01 user nova-compute[75071]: INFO nova.virt.block_device [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Attempting to driver detach volume 493ad899-e7e4-444b-a537-747a7badd313 from mountpoint /dev/vdb
Nov 29 13:35:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Attempting to detach device vdb from instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:35:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:35:01 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:35:01 user nova-compute[75071]:   <source dev="/dev/sdg"/>
Nov 29 13:35:01 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:35:01 user nova-compute[75071]:   <serial>493ad899-e7e4-444b-a537-747a7badd313</serial>
Nov 29 13:35:01 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:35:01 user nova-compute[75071]: </disk>
Nov 29 13:35:01 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:35:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully detached device vdb from instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 from the persistent domain config.
Nov 29 13:35:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:35:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:35:01 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:35:01 user nova-compute[75071]:   <source dev="/dev/sdg"/>
Nov 29 13:35:01 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:35:01 user nova-compute[75071]:   <serial>493ad899-e7e4-444b-a537-747a7badd313</serial>
Nov 29 13:35:01 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:35:01 user nova-compute[75071]: </disk>
Nov 29 13:35:01 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:35:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:35:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 is timed out.
Nov 29 13:35:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully detached device vdb from instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 from the live domain config.
Nov 29 13:35:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KnksNPUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:35:22 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc15a61-9c07-49d5-b44e-c2a463b0b22d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:35:22 user nova-compute[75071]: No targets found.
Nov 29 13:35:22 user nova-compute[75071]: iSNS:
Nov 29 13:35:22 user nova-compute[75071]: No targets found.
Nov 29 13:35:22 user nova-compute[75071]: STATIC:
Nov 29 13:35:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e
Nov 29 13:35:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7
Nov 29 13:35:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb
Nov 29 13:35:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:35:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313
Nov 29 13:35:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:35:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:22 user nova-compute[75071]: FIRMWARE:
Nov 29 13:35:22 user nova-compute[75071]: No targets found.
Nov 29 13:35:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:35:22 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:35:22 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25720b-f964-4511-bc17-32b2d01108b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d80ce8-f2ba-49d7-9490-911f26c38d66]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 (non-flash)
Nov 29 13:35:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:35:22 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 (non-flash)
Nov 29 13:35:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e1a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313'): ({'sdg'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Removing single pathed devices sdg {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b73e6-2ad0-4487-a3d7-6e7999c034cb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb46f09-dd76-47a3-bcb8-68f068797f5d]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Flushing IO for device /dev/sdg {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.030s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd16eb45-4cfa-42ae-aec8-5db81d02820b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f4965-e135-4f37-a50d-8b6229f91600]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0181d81-c371-4c03-bbff-683924f0380c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89f69ca-3d98-4b05-8b7d-443eac5ef1a8]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260]
Nov 29 13:35:22 user nova-compute[75071]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313, portal: 172.16.0.220,3260] successful.
Nov 29 13:35:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:493ad899-e7e4-444b-a537-747a7badd313 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17a41b-6acd-4f89-bd4b-33e656472de2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] <== disconnect_volume: return (354ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:35:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:35:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'flavor' on Instance uuid b7149578-f4eb-4bff-ae81-b2dbec4d9e67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-34caa155-c2b2-42ad-a22c-738453fad767 tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.876s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-changed-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Refreshing instance network info cache due to event network-changed-fe25d636-0ef9-4ca7-a7a0-07e63b9315be. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:35:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] Acquiring lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:35:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] Acquired lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:35:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Refreshing network info cache for port fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG nova.network.neutron [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Updated VIF entry in instance network info cache for port fe25d636-0ef9-4ca7-a7a0-07e63b9315be. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG nova.network.neutron [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Updating instance_info_cache with network_info: [{"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e2f3aa8-1521-44f4-93c2-c37092d832ff req-c76bb355-6060-4d64-b33e-a142b4824230 service nova] Releasing lock "refresh_cache-a3436722-b11d-4ea7-bb8e-239fe37cea51" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:26 user nova-compute[75071]: INFO nova.compute.manager [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Terminating instance
Nov 29 13:35:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Instance destroyed successfully.
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'resources' on Instance uuid a3436722-b11d-4ea7-bb8e-239fe37cea51 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-885511432',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-885511432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-885511432',id=34,image_ref='be6e3114-8d22-46dd-b0bd-bba6dfcc3ae7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTZpedBhadVENsYZrHEjW/L/svkXHRIu14WHGXmqvCCI12+X7zTm6vS8ALByKLQHcBpuBPvyG1aKy6CGAPKbOGTfwA1OOMGfxt3lxYj0vQiboIgCVPLOk6wzpNZ3Ugg3A==',key_name='tempest-keypair-323962342',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-r9rmq93m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2055293783',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=a3436722-b11d-4ea7-bb8e-239fe37cea51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "address": "fa:16:3e:7f:d8:60", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe25d636-0e", "ovs_interfaceid": "fe25d636-0ef9-4ca7-a7a0-07e63b9315be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d8:60,bridge_name='br-int',has_traffic_filtering=True,id=fe25d636-0ef9-4ca7-a7a0-07e63b9315be,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe25d636-0e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_vif [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d8:60,bridge_name='br-int',has_traffic_filtering=True,id=fe25d636-0ef9-4ca7-a7a0-07e63b9315be,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe25d636-0e') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe25d636-0e, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa0129db-5497-48b6-a343-01640517ee81) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:27 user nova-compute[75071]: INFO os_vif [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:d8:60,bridge_name='br-int',has_traffic_filtering=True,id=fe25d636-0ef9-4ca7-a7a0-07e63b9315be,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe25d636-0e')
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGJQVFnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:35:27 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9dab20-1a90-4431-bd21-00cb31ae624e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:35:27 user nova-compute[75071]: No targets found.
Nov 29 13:35:27 user nova-compute[75071]: iSNS:
Nov 29 13:35:27 user nova-compute[75071]: No targets found.
Nov 29 13:35:27 user nova-compute[75071]: STATIC:
Nov 29 13:35:27 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e
Nov 29 13:35:27 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:27 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:27 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7
Nov 29 13:35:27 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:27 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:27 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb
Nov 29 13:35:27 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:27 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:27 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:35:27 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:27 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:27 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:35:27 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:35:27 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:35:27 user nova-compute[75071]: FIRMWARE:
Nov 29 13:35:27 user nova-compute[75071]: No targets found.
Nov 29 13:35:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:35:27 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:35:27 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea928094-34ae-4a12-9db8-ff611c82e3f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5486fb-8897-4c11-a05a-5c992466f1e1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:35:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e (non-flash)
Nov 29 13:35:27 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:35:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fad120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cd65cf-937e-48b3-8780-5d49dce238dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c115c-ab65-4091-bfa1-bc626a34e168]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57a3c5f-a82e-4b6d-9a3f-efb85f46e2f3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a9ddd-1bc5-41cc-9201-117f4d0a393d]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[022e2a46-b295-41a6-b02a-2516de0e231e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a925ac-5030-4bb8-986e-df766330ef91]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260]
Nov 29 13:35:27 user nova-compute[75071]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e, portal: 172.16.0.220,3260] successful.
Nov 29 13:35:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f39e81a0-692a-421b-908b-946fb5370d6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[915eb4ff-267c-4114-913f-9704f195b59e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== disconnect_volume: return (314ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:35:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Deleting instance files /opt/stack/data/nova/instances/a3436722-b11d-4ea7-bb8e-239fe37cea51_del
Nov 29 13:35:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Deletion of /opt/stack/data/nova/instances/a3436722-b11d-4ea7-bb8e-239fe37cea51_del complete
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-vif-unplugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] No waiting events found dispatching network-vif-unplugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-vif-unplugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] Acquiring lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] No waiting events found dispatching network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:35:27 user nova-compute[75071]: WARNING nova.compute.manager [req-5265d1b7-c4ff-4c06-8b84-fe255821949f req-4e96dd00-cd1a-4d56-a1e2-56b7c2a95490 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received unexpected event network-vif-plugged-fe25d636-0ef9-4ca7-a7a0-07e63b9315be for instance with vm_state active and task_state deleting.
Nov 29 13:35:27 user nova-compute[75071]: INFO nova.compute.manager [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 29 13:35:27 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:35:27 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:35:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:28 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:35:28 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Took 1.11 seconds to deallocate network for instance.
Nov 29 13:35:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-a839d4da-94c2-466e-be4c-50489fae6d3c req-8cdfa75a-6ab4-4786-95f1-357eb77e61a0 service nova] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Received event network-vif-deleted-fe25d636-0ef9-4ca7-a7a0-07e63b9315be {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:29 user nova-compute[75071]: INFO nova.compute.manager [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Took 0.83 seconds to detach 1 volumes for instance.
Nov 29 13:35:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: a3436722-b11d-4ea7-bb8e-239fe37cea51] Deleting volume: f39e81a0-692a-421b-908b-946fb5370d6e {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 13:35:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:30 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:35:30 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:35:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:30 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Deleted allocations for instance a3436722-b11d-4ea7-bb8e-239fe37cea51
Nov 29 13:35:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4314fc2e-0d01-4a77-a22c-acc1d4182403 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "a3436722-b11d-4ea7-bb8e-239fe37cea51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.782s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:35:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:51 user nova-compute[75071]: INFO nova.compute.manager [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Terminating instance
Nov 29 13:35:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f076d6a-f876-4c96-ad7c-cdac289ae685 req-de7a6e78-03b3-4adb-a5f7-235241927b40 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-vif-unplugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f076d6a-f876-4c96-ad7c-cdac289ae685 req-de7a6e78-03b3-4adb-a5f7-235241927b40 service nova] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f076d6a-f876-4c96-ad7c-cdac289ae685 req-de7a6e78-03b3-4adb-a5f7-235241927b40 service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f076d6a-f876-4c96-ad7c-cdac289ae685 req-de7a6e78-03b3-4adb-a5f7-235241927b40 service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f076d6a-f876-4c96-ad7c-cdac289ae685 req-de7a6e78-03b3-4adb-a5f7-235241927b40 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] No waiting events found dispatching network-vif-unplugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f076d6a-f876-4c96-ad7c-cdac289ae685 req-de7a6e78-03b3-4adb-a5f7-235241927b40 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-vif-unplugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Instance destroyed successfully.
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lazy-loading 'resources' on Instance uuid b7149578-f4eb-4bff-ae81-b2dbec4d9e67 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1995243802',display_name='tempest-AttachVolumeNegativeTest-server-1995243802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1995243802',id=33,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODl99MKHt29o5kln8kZg4o5GLT0E/Qde1HkDvz4510nWA5Jb0FTsfYY2aA7FX4JLvcGh4ck0ZWnATep9p7wqkKHcxZ3u6o73SEFMHi33WvGB6zyxnTHgv0XehVj/iCX5g==',key_name='tempest-keypair-2133524706',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:33:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9f00a9cd6fd4b4398314100706a720b',ramdisk_id='',reservation_id='r-mcbx5zj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1996696047',owner_user_name='tempest-AttachVolumeNegativeTest-1996696047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:33:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='350e0cf65eeb441582c203ac06668009',uuid=b7149578-f4eb-4bff-ae81-b2dbec4d9e67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converting VIF {"id": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "address": "fa:16:3e:4f:77:43", "network": {"id": "9cd717be-6c85-492e-9d39-d88482a1c3a4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1315306759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9f00a9cd6fd4b4398314100706a720b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap178245a4-9c", "ovs_interfaceid": "178245a4-9cc5-4c5c-82a7-6bcaa2aa7643", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:77:43,bridge_name='br-int',has_traffic_filtering=True,id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178245a4-9c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG os_vif [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:77:43,bridge_name='br-int',has_traffic_filtering=True,id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178245a4-9c') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap178245a4-9c, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=728da802-be5e-45b1-a3e3-2ebbe162f00c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:52 user nova-compute[75071]: INFO os_vif [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:77:43,bridge_name='br-int',has_traffic_filtering=True,id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643,network=Network(9cd717be-6c85-492e-9d39-d88482a1c3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap178245a4-9c')
Nov 29 13:35:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Deleting instance files /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67_del
Nov 29 13:35:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Deletion of /opt/stack/data/nova/instances/b7149578-f4eb-4bff-ae81-b2dbec4d9e67_del complete
Nov 29 13:35:52 user nova-compute[75071]: INFO nova.compute.manager [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 13:35:52 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:35:52 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-b431935b-b0e2-4c0b-9a57-26c937f99247 req-812f7e67-c982-4123-a97f-5051cab1af58 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-vif-deleted-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:53 user nova-compute[75071]: INFO nova.compute.manager [req-b431935b-b0e2-4c0b-9a57-26c937f99247 req-812f7e67-c982-4123-a97f-5051cab1af58 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Neutron deleted interface 178245a4-9cc5-4c5c-82a7-6bcaa2aa7643; detaching it from the instance and deleting it from the info cache
Nov 29 13:35:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-b431935b-b0e2-4c0b-9a57-26c937f99247 req-812f7e67-c982-4123-a97f-5051cab1af58 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:35:53 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Took 0.76 seconds to deallocate network for instance.
Nov 29 13:35:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-b431935b-b0e2-4c0b-9a57-26c937f99247 req-812f7e67-c982-4123-a97f-5051cab1af58 service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Detach interface failed, port_id=178245a4-9cc5-4c5c-82a7-6bcaa2aa7643, reason: Instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:53 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Deleted allocations for instance b7149578-f4eb-4bff-ae81-b2dbec4d9e67
Nov 29 13:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f69469b-f814-43df-a41b-2760b94f86bd tempest-AttachVolumeNegativeTest-1996696047 tempest-AttachVolumeNegativeTest-1996696047-project-member] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquired lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'info_cache' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.base [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a8c9cef-a93c-4bae-8d67-0ccc1aa43a7a req-890bb228-e117-44dc-996a-d07272c37e4d service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received event network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a8c9cef-a93c-4bae-8d67-0ccc1aa43a7a req-890bb228-e117-44dc-996a-d07272c37e4d service nova] Acquiring lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a8c9cef-a93c-4bae-8d67-0ccc1aa43a7a req-890bb228-e117-44dc-996a-d07272c37e4d service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a8c9cef-a93c-4bae-8d67-0ccc1aa43a7a req-890bb228-e117-44dc-996a-d07272c37e4d service nova] Lock "b7149578-f4eb-4bff-ae81-b2dbec4d9e67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a8c9cef-a93c-4bae-8d67-0ccc1aa43a7a req-890bb228-e117-44dc-996a-d07272c37e4d service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] No waiting events found dispatching network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:35:54 user nova-compute[75071]: WARNING nova.compute.manager [req-2a8c9cef-a93c-4bae-8d67-0ccc1aa43a7a req-890bb228-e117-44dc-996a-d07272c37e4d service nova] [instance: b7149578-f4eb-4bff-ae81-b2dbec4d9e67] Received unexpected event network-vif-plugged-178245a4-9cc5-4c5c-82a7-6bcaa2aa7643 for instance with vm_state deleted and task_state None.
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating instance_info_cache with network_info: [{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Releasing lock "refresh_cache-f9101862-4ab0-4973-84a7-411ab276084d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:35:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance destroyed successfully.
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'resources' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.base [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG os_vif [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a2c6093-ff, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a56dd59f-4833-47d0-b188-604b57c39eff) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:54 user nova-compute[75071]: INFO os_vif [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff')
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Start _get_guest_xml network_info=[{"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'numa_topology' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.base [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:35:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:35:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.base [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'pci_devices' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.objects.base [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:35:54 user nova-compute[75071]:   <uuid>f9101862-4ab0-4973-84a7-411ab276084d</uuid>
Nov 29 13:35:54 user nova-compute[75071]:   <name>instance-00000019</name>
Nov 29 13:35:54 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:35:54 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:35:54 user nova-compute[75071]:   <metadata>
Nov 29 13:35:54 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:35:54 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:35:54 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-489273326</nova:name>
Nov 29 13:35:54 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:35:54</nova:creationTime>
Nov 29 13:35:54 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:35:54 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:35:54 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:35:54 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:35:54 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:35:54 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:35:54 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:35:54 user nova-compute[75071]:       <nova:owner>
Nov 29 13:35:54 user nova-compute[75071]:         <nova:user uuid="80b78150bab7440daf6d7fe0d25d4cf2">tempest-AttachVolumeTestJSON-964246432-project-member</nova:user>
Nov 29 13:35:54 user nova-compute[75071]:         <nova:project uuid="9fead1ec3dc0456eb2dd2290009247a9">tempest-AttachVolumeTestJSON-964246432</nova:project>
Nov 29 13:35:54 user nova-compute[75071]:       </nova:owner>
Nov 29 13:35:54 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:35:54 user nova-compute[75071]:       <nova:ports>
Nov 29 13:35:54 user nova-compute[75071]:         <nova:port uuid="2a2c6093-ffca-45b4-95f9-b612afba26a5">
Nov 29 13:35:54 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:35:54 user nova-compute[75071]:         </nova:port>
Nov 29 13:35:54 user nova-compute[75071]:       </nova:ports>
Nov 29 13:35:54 user nova-compute[75071]:     </nova:instance>
Nov 29 13:35:54 user nova-compute[75071]:   </metadata>
Nov 29 13:35:54 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:35:54 user nova-compute[75071]:     <system>
Nov 29 13:35:54 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:35:54 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:35:54 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:35:54 user nova-compute[75071]:       <entry name="serial">f9101862-4ab0-4973-84a7-411ab276084d</entry>
Nov 29 13:35:54 user nova-compute[75071]:       <entry name="uuid">f9101862-4ab0-4973-84a7-411ab276084d</entry>
Nov 29 13:35:54 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:35:54 user nova-compute[75071]:     </system>
Nov 29 13:35:54 user nova-compute[75071]:   </sysinfo>
Nov 29 13:35:54 user nova-compute[75071]:   <os>
Nov 29 13:35:54 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:35:54 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:35:54 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:35:54 user nova-compute[75071]:   </os>
Nov 29 13:35:54 user nova-compute[75071]:   <features>
Nov 29 13:35:54 user nova-compute[75071]:     <acpi/>
Nov 29 13:35:54 user nova-compute[75071]:     <apic/>
Nov 29 13:35:54 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:35:54 user nova-compute[75071]:   </features>
Nov 29 13:35:54 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:35:54 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:35:54 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:35:54 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:35:54 user nova-compute[75071]:   </clock>
Nov 29 13:35:54 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:35:54 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:35:54 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:35:54 user nova-compute[75071]:   </cpu>
Nov 29 13:35:54 user nova-compute[75071]:   <devices>
Nov 29 13:35:54 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:35:54 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:35:54 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk"/>
Nov 29 13:35:54 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:35:54 user nova-compute[75071]:     </disk>
Nov 29 13:35:54 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:35:54 user nova-compute[75071]:       <mac address="fa:16:3e:a4:e6:92"/>
Nov 29 13:35:54 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:35:54 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:35:54 user nova-compute[75071]:       <target dev="tap2a2c6093-ff"/>
Nov 29 13:35:54 user nova-compute[75071]:     </interface>
Nov 29 13:35:54 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:35:54 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/console.log" append="off"/>
Nov 29 13:35:54 user nova-compute[75071]:     </serial>
Nov 29 13:35:54 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:35:54 user nova-compute[75071]:     <video>
Nov 29 13:35:54 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:35:54 user nova-compute[75071]:     </video>
Nov 29 13:35:54 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:35:54 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:35:54 user nova-compute[75071]:     </rng>
Nov 29 13:35:54 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:35:54 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:35:54 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:35:54 user nova-compute[75071]:     </memballoon>
Nov 29 13:35:54 user nova-compute[75071]:   </devices>
Nov 29 13:35:54 user nova-compute[75071]: </domain>
Nov 29 13:35:54 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:35:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:35:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid 'f9101862-4ab0-4973-84a7-411ab276084d' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f9101862-4ab0-4973-84a7-411ab276084d' (instance-00000019)
Nov 29 13:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.objects.base [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.422s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:35:55 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:35:55 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=24.99285888671875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 64806dd7-0adb-4bb2-954a-707928115ce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 08de871b-9fc3-4766-b32a-01d809a2d4c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b6ed42c9-2b8c-4f2a-930e-81ba854778be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6a2550b8-269a-4cfb-887b-a3f3745812a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Cannot resize image /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.objects.instance [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'migration_context' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.objects.base [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Object Instance<f9101862-4ab0-4973-84a7-411ab276084d> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG os_vif [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bf45b21-28d5-5af4-9a3b-34a7225378fa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a2c6093-ff, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a2c6093-ff, col_values=(('qos', UUID('b16cab1b-a347-4ba8-b769-27f38482b03d')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a2c6093-ff, col_values=(('external_ids', {'iface-id': '2a2c6093-ffca-45b4-95f9-b612afba26a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:e6:92', 'vm-uuid': 'f9101862-4ab0-4973-84a7-411ab276084d'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:55 user nova-compute[75071]: INFO os_vif [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff')
Nov 29 13:35:56 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:35:56 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:35:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 64806dd7-0adb-4bb2-954a-707928115ce9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-47cc92a6-a540-4ea7-a085-da10bc64284d req-104665e7-0ff3-492c-a94f-b03b1d3d9827 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47cc92a6-a540-4ea7-a085-da10bc64284d req-104665e7-0ff3-492c-a94f-b03b1d3d9827 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47cc92a6-a540-4ea7-a085-da10bc64284d req-104665e7-0ff3-492c-a94f-b03b1d3d9827 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47cc92a6-a540-4ea7-a085-da10bc64284d req-104665e7-0ff3-492c-a94f-b03b1d3d9827 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-47cc92a6-a540-4ea7-a085-da10bc64284d req-104665e7-0ff3-492c-a94f-b03b1d3d9827 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:35:57 user nova-compute[75071]: WARNING nova.compute.manager [req-47cc92a6-a540-4ea7-a085-da10bc64284d req-104665e7-0ff3-492c-a94f-b03b1d3d9827 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state stopped and task_state powering-on.
Nov 29 13:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [{"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-64806dd7-0adb-4bb2-954a-707928115ce9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:35:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:35:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance rebooted successfully.
Nov 29 13:35:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-63428c9c-7215-4bae-845a-7284c398c5ab tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-2cc3f7f3-4add-42d5-a347-413e47394789 req-555cc047-ba82-48c1-a844-71d601e1d03d service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2cc3f7f3-4add-42d5-a347-413e47394789 req-555cc047-ba82-48c1-a844-71d601e1d03d service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2cc3f7f3-4add-42d5-a347-413e47394789 req-555cc047-ba82-48c1-a844-71d601e1d03d service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2cc3f7f3-4add-42d5-a347-413e47394789 req-555cc047-ba82-48c1-a844-71d601e1d03d service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-2cc3f7f3-4add-42d5-a347-413e47394789 req-555cc047-ba82-48c1-a844-71d601e1d03d service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:35:59 user nova-compute[75071]: WARNING nova.compute.manager [req-2cc3f7f3-4add-42d5-a347-413e47394789 req-555cc047-ba82-48c1-a844-71d601e1d03d service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state active and task_state None.
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:35:59 user nova-compute[75071]: INFO nova.compute.manager [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Terminating instance
Nov 29 13:35:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:35:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6c11c88-b345-4653-aca1-6116b755d10a req-6494e06f-a427-42a7-a68f-dcacd5f121f6 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6c11c88-b345-4653-aca1-6116b755d10a req-6494e06f-a427-42a7-a68f-dcacd5f121f6 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6c11c88-b345-4653-aca1-6116b755d10a req-6494e06f-a427-42a7-a68f-dcacd5f121f6 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6c11c88-b345-4653-aca1-6116b755d10a req-6494e06f-a427-42a7-a68f-dcacd5f121f6 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6c11c88-b345-4653-aca1-6116b755d10a req-6494e06f-a427-42a7-a68f-dcacd5f121f6 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6c11c88-b345-4653-aca1-6116b755d10a req-6494e06f-a427-42a7-a68f-dcacd5f121f6 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Instance destroyed successfully.
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'resources' on Instance uuid 08de871b-9fc3-4766-b32a-01d809a2d4c1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:29:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-553239605',display_name='tempest-ServerActionsTestOtherA-server-553239605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-553239605',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-8xt3hjum',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:33:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=08de871b-9fc3-4766-b32a-01d809a2d4c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "address": "fa:16:3e:c7:ca:fe", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf27380-50", "ovs_interfaceid": "4bf27380-50d5-48e1-bf2d-4bd5cc33020c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_vif [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bf27380-50, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7650936-374f-46f4-b3cc-53b5e8176601) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:36:00 user nova-compute[75071]: INFO os_vif [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ca:fe,bridge_name='br-int',has_traffic_filtering=True,id=4bf27380-50d5-48e1-bf2d-4bd5cc33020c,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf27380-50')
Nov 29 13:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgnjvOrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:36:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8c6e5e-9ce3-4990-834b-56286519e433]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:36:00 user nova-compute[75071]: No targets found.
Nov 29 13:36:00 user nova-compute[75071]: iSNS:
Nov 29 13:36:00 user nova-compute[75071]: No targets found.
Nov 29 13:36:00 user nova-compute[75071]: STATIC:
Nov 29 13:36:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7
Nov 29 13:36:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:36:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:36:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb
Nov 29 13:36:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:36:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:36:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d
Nov 29 13:36:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:36:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:36:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:36:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:36:00 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:36:00 user nova-compute[75071]: FIRMWARE:
Nov 29 13:36:00 user nova-compute[75071]: No targets found.
Nov 29 13:36:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:36:00 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:36:00 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[409bcb86-ff54-4118-b691-b8f12ba6364c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9159763-30e7-48ed-ab9a-af5ae2630f91]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:36:00 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:36:00 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:36:00 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:36:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:36:00 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d (non-flash)
Nov 29 13:36:00 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:36:00 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:36:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e3bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a5965a-ec7c-4954-9d9e-de611f823d91]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34417d51-e7c4-4c6c-a81d-c517cfada848]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce563bb-cba6-4d47-a607-0015c907ffcb]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.073s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27c893d-808b-4361-9489-ce60b3e36f62]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_449317f6', '/dev/disk/by-id/scsi-1SCST_BIO449317f6-8c508a8b9eb2f759', '/dev/disk/by-id/scsi-23863353038613862') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1770159-7909-4d81-b2ff-dabb40ee9494]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1b60ac-22fa-48da-b6a7-4de88d205376]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead8113a-6ea3-4d2e-81e6-5d1bb4efdedb]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260]
Nov 29 13:36:00 user nova-compute[75071]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d, portal: 172.16.0.220,3260] successful.
Nov 29 13:36:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604afe3-29c9-401a-ac33-2cdb4841849d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b12c14-f709-4c18-97e7-4f276697cad8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] <== disconnect_volume: return (400ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:36:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Deleting instance files /opt/stack/data/nova/instances/08de871b-9fc3-4766-b32a-01d809a2d4c1_del
Nov 29 13:36:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Deletion of /opt/stack/data/nova/instances/08de871b-9fc3-4766-b32a-01d809a2d4c1_del complete
Nov 29 13:36:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:01 user nova-compute[75071]: INFO nova.compute.manager [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 29 13:36:01 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:36:01 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:01 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Took 0.86 seconds to deallocate network for instance.
Nov 29 13:36:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-7ec6be31-acc0-4316-b161-b55ab7053a0d req-a9e83d21-007a-4e2d-8c9c-90d5e47d5f18 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-deleted-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:02 user nova-compute[75071]: WARNING nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state deleting.
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:02 user nova-compute[75071]: WARNING nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state deleting.
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:02 user nova-compute[75071]: WARNING nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state deleting.
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-unplugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Acquiring lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] No waiting events found dispatching network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:02 user nova-compute[75071]: WARNING nova.compute.manager [req-0f1bf146-ac13-47f6-8e9c-7c4bffb25dc3 req-cd6ded1d-c267-4f2e-8cbb-5386180f5ff3 service nova] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Received unexpected event network-vif-plugged-4bf27380-50d5-48e1-bf2d-4bd5cc33020c for instance with vm_state active and task_state deleting.
Nov 29 13:36:02 user nova-compute[75071]: INFO nova.compute.manager [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Took 0.93 seconds to detach 1 volumes for instance.
Nov 29 13:36:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 08de871b-9fc3-4766-b32a-01d809a2d4c1] Deleting volume: 3604afe3-29c9-401a-ac33-2cdb4841849d {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:36:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:36:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:03 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Deleted allocations for instance 08de871b-9fc3-4766-b32a-01d809a2d4c1
Nov 29 13:36:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b57dadc-01af-434a-ad57-f75124362a79 tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "08de871b-9fc3-4766-b32a-01d809a2d4c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.717s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:36:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:18 user nova-compute[75071]: INFO nova.compute.manager [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Unshelving
Nov 29 13:36:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:36:18 user nova-compute[75071]: INFO nova.compute.claims [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Claim successful on node user
Nov 29 13:36:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:18 user nova-compute[75071]: INFO nova.network.neutron [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating port 8a523b75-f9bb-49e1-bca9-a09400acd9ab with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:18 user nova-compute[75071]: INFO nova.compute.manager [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Rescuing
Nov 29 13:36:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:36:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updating instance_info_cache with network_info: [{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-0398292e-3f45-4a20-8b29-d3d950b5228b req-57403066-c0cf-43ae-a928-44796fa2dc1f service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0398292e-3f45-4a20-8b29-d3d950b5228b req-57403066-c0cf-43ae-a928-44796fa2dc1f service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0398292e-3f45-4a20-8b29-d3d950b5228b req-57403066-c0cf-43ae-a928-44796fa2dc1f service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0398292e-3f45-4a20-8b29-d3d950b5228b req-57403066-c0cf-43ae-a928-44796fa2dc1f service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-0398292e-3f45-4a20-8b29-d3d950b5228b req-57403066-c0cf-43ae-a928-44796fa2dc1f service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:19 user nova-compute[75071]: WARNING nova.compute.manager [req-0398292e-3f45-4a20-8b29-d3d950b5228b req-57403066-c0cf-43ae-a928-44796fa2dc1f service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state active and task_state rescuing.
Nov 29 13:36:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquired lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing instance network info cache due to event network-changed-8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:36:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] Acquiring lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Releasing lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:36:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Creating image(s)
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.objects.instance [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] Acquired lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Refreshing network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.objects.base [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<9f62ede8-a1ed-411a-9720-b187674f974f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "e71d1a9612c6610f0a853ad34e05bb3a18436d1b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "e71d1a9612c6610f0a853ad34e05bb3a18436d1b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance destroyed successfully.
Nov 29 13:36:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Attempting a stable device rescue
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:36:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Creating image(s)
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "/opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "c77bdfb46320cb777a250cce155f55cf181a91ea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "c77bdfb46320cb777a250cce155f55cf181a91ea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:21 user nova-compute[75071]: INFO nova.compute.manager [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Terminating instance
Nov 29 13:36:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:22 user nova-compute[75071]: WARNING nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state active and task_state rescuing.
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-vif-unplugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] No waiting events found dispatching network-vif-unplugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-vif-unplugged-f4114f62-6b07-4f02-9663-f1095f018f53 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Acquiring lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] No waiting events found dispatching network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:22 user nova-compute[75071]: WARNING nova.compute.manager [req-758c677f-69ee-4669-b865-63d9c3539d93 req-989eedd4-fe6e-4310-b3d8-2d8fba400bf2 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received unexpected event network-vif-plugged-f4114f62-6b07-4f02-9663-f1095f018f53 for instance with vm_state active and task_state deleting.
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.part --force-share --output=json" returned: 0 in 1.152s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.virt.images [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] d2097cb5-9a77-45fb-a4df-c3014195356f was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.part /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Instance destroyed successfully.
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'resources' on Instance uuid b6ed42c9-2b8c-4f2a-930e-81ba854778be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-928000202',display_name='tempest-TestVolumeBootPattern-volume-backed-server-928000202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-928000202',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlncUKhJODS8bDP2iD5JX44F5O8Xnr3YVeB7zhBvTRmlLBSgCueVcjAdhgNV4abehGVx+meFJ0eZhgHAew79Xi/xLyiLph80U3tYOwWux6F2h3Y4GtTAjUGJOlPTVT5Tw==',key_name='tempest-keypair-358548769',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-00lr1u6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=b6ed42c9-2b8c-4f2a-930e-81ba854778be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "f4114f62-6b07-4f02-9663-f1095f018f53", "address": "fa:16:3e:ef:3d:7b", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4114f62-6b", "ovs_interfaceid": "f4114f62-6b07-4f02-9663-f1095f018f53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:3d:7b,bridge_name='br-int',has_traffic_filtering=True,id=f4114f62-6b07-4f02-9663-f1095f018f53,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4114f62-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_vif [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:3d:7b,bridge_name='br-int',has_traffic_filtering=True,id=f4114f62-6b07-4f02-9663-f1095f018f53,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4114f62-6b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4114f62-6b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.virt.images [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] c7df0785-449a-4f5a-8c84-977063de4927 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.part /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abba884c-55a4-4474-aacb-b93fd34a9912) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:22 user nova-compute[75071]: INFO os_vif [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:3d:7b,bridge_name='br-int',has_traffic_filtering=True,id=f4114f62-6b07-4f02-9663-f1095f018f53,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4114f62-6b')
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmshICuH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:36:22 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a891ac5a-a655-4933-8365-9e1140e9a0e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:36:22 user nova-compute[75071]: No targets found.
Nov 29 13:36:22 user nova-compute[75071]: iSNS:
Nov 29 13:36:22 user nova-compute[75071]: No targets found.
Nov 29 13:36:22 user nova-compute[75071]: STATIC:
Nov 29 13:36:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7
Nov 29 13:36:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:36:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:36:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb
Nov 29 13:36:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:36:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:36:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:36:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:36:22 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:36:22 user nova-compute[75071]: FIRMWARE:
Nov 29 13:36:22 user nova-compute[75071]: No targets found.
Nov 29 13:36:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:36:22 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:36:22 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updated VIF entry in instance network info cache for port 8a523b75-f9bb-49e1-bca9-a09400acd9ab. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964d85b-ae7e-448c-af52-4947a4c630e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-698b93ef-4bc3-47bc-b420-58d9082560c3 req-fd333673-8180-4631-8d30-78c272d1871a service nova] Releasing lock "refresh_cache-9f62ede8-a1ed-411a-9720-b187674f974f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a784b2-388d-4182-804c-9b5b3e248a2f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:36:22 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:36:22 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:36:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:36:22 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 (non-flash)
Nov 29 13:36:22 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:36:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148352680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.068s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa933af-ec05-4834-b4fb-362b88c6a32d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.part /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.converted" returned: 0 in 0.395s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b6c89-23ad-432b-9f75-818a6f5fa456]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1adf4c4-28db-446b-87b7-3b516ead6994]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.part /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.converted" returned: 0 in 0.417s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.078s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2c82f6-2788-4f2d-a993-92834fea8142]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60cab5-b1a8-46c9-8069-5e1a4cacfa66]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "e71d1a9612c6610f0a853ad34e05bb3a18436d1b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.788s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d11e80-b23c-4df8-9d02-9ad404b9f7b8]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260]
Nov 29 13:36:23 user nova-compute[75071]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7, portal: 172.16.0.220,3260] successful.
Nov 29 13:36:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d565c67-801a-4103-aa90-bdf35052ee77]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.524s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== disconnect_volume: return (526ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:36:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Deleting instance files /opt/stack/data/nova/instances/b6ed42c9-2b8c-4f2a-930e-81ba854778be_del
Nov 29 13:36:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Deletion of /opt/stack/data/nova/instances/b6ed42c9-2b8c-4f2a-930e-81ba854778be_del complete
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "c77bdfb46320cb777a250cce155f55cf181a91ea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.796s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "c77bdfb46320cb777a250cce155f55cf181a91ea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "c77bdfb46320cb777a250cce155f55cf181a91ea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: INFO nova.compute.manager [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Took 1.89 seconds to destroy the instance on the hypervisor.
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "e71d1a9612c6610f0a853ad34e05bb3a18436d1b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "e71d1a9612c6610f0a853ad34e05bb3a18436d1b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea,backing_fmt=raw /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea,backing_fmt=raw /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue" returned: 0 in 0.048s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "c77bdfb46320cb777a250cce155f55cf181a91ea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'migration_context' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<6a2550b8-269a-4cfb-887b-a3f3745812a1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Start _get_guest_xml network_info=[{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "vif_mac": "fa:16:3e:4d:19:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c7df0785-449a-4f5a-8c84-977063de4927', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAHiDyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '6a2550b8-269a-4cfb-887b-a3f3745812a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f230d135-cd25-43ac-a400-03ebd6fd03fb', 'serial': 'f230d135-cd25-43ac-a400-03ebd6fd03fb'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '5bf3616a-56aa-4875-a026-1196de26118e', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'resources' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b,backing_fmt=raw /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<6a2550b8-269a-4cfb-887b-a3f3745812a1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b,backing_fmt=raw /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk 1073741824" returned: 0 in 0.052s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "e71d1a9612c6610f0a853ad34e05bb3a18436d1b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<6a2550b8-269a-4cfb-887b-a3f3745812a1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:36:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<6a2550b8-269a-4cfb-887b-a3f3745812a1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAHiDyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:36:23 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:36:23 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:36:23 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d6c042-0cac-467e-aa72-4d2e50742f44]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tAHiDyof\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 13:36:23 user nova-compute[75071]: node.name = iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb
Nov 29 13:36:23 user nova-compute[75071]: node.tpgt = -1
Nov 29 13:36:23 user nova-compute[75071]: node.startup = automatic
Nov 29 13:36:23 user nova-compute[75071]: node.leading_login = No
Nov 29 13:36:23 user nova-compute[75071]: iface.iscsi_ifacename = default
Nov 29 13:36:23 user nova-compute[75071]: iface.net_ifacename = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.ipaddress = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.prefix_len = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.hwaddress = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.transport_name = tcp
Nov 29 13:36:23 user nova-compute[75071]: iface.initiatorname = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.state = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.vlan_id = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.vlan_priority = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.vlan_state = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.iface_num = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.mtu = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.port = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.bootproto = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.subnet_mask = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.gateway = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_alt_client_id = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_dns = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_learn_iqn = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_vendor_id_state = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_vendor_id = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.dhcp_slp_da = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.fragmentation = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.gratuitous_arp = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.incoming_forwarding = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.tos_state = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.tos = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.ttl = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.delayed_ack = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.tcp_nagle = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.tcp_wsf_state = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.tcp_wsf = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.tcp_timer_scale = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.tcp_timestamp = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.redirect = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.def_task_mgmt_timeout = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.header_digest = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.data_digest = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.immediate_data = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.initial_r2t = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.data_seq_inorder = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.data_pdu_inorder = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.erl = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.max_receive_data_len = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.first_burst_len = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.max_outstanding_r2t = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.max_burst_len = 0
Nov 29 13:36:23 user nova-compute[75071]: iface.chap_auth = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.bidi_chap = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.strict_login_compliance = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.discovery_auth = <empty>
Nov 29 13:36:23 user nova-compute[75071]: iface.discovery_logout = <empty>
Nov 29 13:36:23 user nova-compute[75071]: node.discovery_address = <empty>
Nov 29 13:36:23 user nova-compute[75071]: node.discovery_port = 0
Nov 29 13:36:23 user nova-compute[75071]: node.discovery_type = static
Nov 29 13:36:23 user nova-compute[75071]: node.session.initial_cmdsn = 0
Nov 29 13:36:23 user nova-compute[75071]: node.session.initial_login_retry_max = 8
Nov 29 13:36:23 user nova-compute[75071]: node.session.xmit_thread_priority = -20
Nov 29 13:36:23 user nova-compute[75071]: node.session.cmds_max = 128
Nov 29 13:36:23 user nova-compute[75071]: node.session.queue_depth = 32
Nov 29 13:36:23 user nova-compute[75071]: node.session.nr_sessions = 1
Nov 29 13:36:23 user nova-compute[75071]: node.session.auth.authmethod = CHAP
Nov 29 13:36:23 user nova-compute[75071]: node.session.auth.username = tAHiDyof
Nov 29 13:36:23 user nova-compute[75071]: node.session.auth.password = ***
Nov 29 13:36:23 user nova-compute[75071]: node.session.auth.username_in = <empty>
Nov 29 13:36:23 user nova-compute[75071]: node.session.auth.password_in = <empty>
Nov 29 13:36:23 user nova-compute[75071]: node.session.auth.chap_algs = MD5
Nov 29 13:36:23 user nova-compute[75071]: node.session.timeo.replacement_timeout = 120
Nov 29 13:36:23 user nova-compute[75071]: node.session.err_timeo.abort_timeout = 15
Nov 29 13:36:23 user nova-compute[75071]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 13:36:23 user nova-compute[75071]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 13:36:23 user nova-compute[75071]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.FastAbort = Yes
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.InitialR2T = No
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.ImmediateData = Yes
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.MaxConnections = 1
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 13:36:23 user nova-compute[75071]: node.session.iscsi.ERL = 0
Nov 29 13:36:23 user nova-compute[75071]: node.session.scan = manual
Nov 29 13:36:23 user nova-compute[75071]: node.session.reopen_max = 0
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].address = 172.16.0.220
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].port = 3260
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].startup = manual
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].tcp.window_size = 524288
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].tcp.type_of_service = 0
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].timeo.logout_timeout = 15
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].timeo.login_timeout = 15
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].timeo.auth_timeout = 45
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].iscsi.DataDigest = None
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].iscsi.IFMarker = No
Nov 29 13:36:23 user nova-compute[75071]: node.conn[0].iscsi.OFMarker = No
Nov 29 13:36:23 user nova-compute[75071]: # END RECORD
Nov 29 13:36:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9166e2-2c97-49b6-87b8-5544840cda50]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'migration_context' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.base [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<9f62ede8-a1ed-411a-9720-b187674f974f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Rebasing disk image.
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a784b415-d9ac-41f5-826b-561a42667e1c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAHiDyof {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAHiDyof" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37adf67e-3a4b-4673-948b-fc80936d6d6c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAHiDyof'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[632365e0-2207-4717-9bac-db7ebe32aab6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[205f8b0b-13f0-419b-898d-739ef2622616]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:36:23 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:36:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:36:23 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:36:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.209s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] HCTL ('36', '0', '0', 0) found on session 42 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cba4624-163e-463e-b454-aef7746848c3]: (4, ('0 0 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Searching for a device in session 42 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAHiDyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.236s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== connect_volume: return (238ms) {'type': 'block', 'scsi_wwn': '26266396436626366', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266396436626366', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 -F raw /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836993308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836993308',id=35,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-hnur9bum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:34:48Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=6a2550b8-269a-4cfb-887b-a3f3745812a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "vif_mac": "fa:16:3e:4d:19:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "vif_mac": "fa:16:3e:4d:19:86"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.objects.base [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Object Instance<6a2550b8-269a-4cfb-887b-a3f3745812a1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:36:23 user nova-compute[75071]:   <uuid>6a2550b8-269a-4cfb-887b-a3f3745812a1</uuid>
Nov 29 13:36:23 user nova-compute[75071]:   <name>instance-00000023</name>
Nov 29 13:36:23 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:36:23 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:36:23 user nova-compute[75071]:   <metadata>
Nov 29 13:36:23 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:36:23 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:36:23 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-836993308</nova:name>
Nov 29 13:36:23 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:36:23</nova:creationTime>
Nov 29 13:36:23 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:36:23 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:36:23 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:36:23 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:36:23 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:36:23 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:36:23 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:36:23 user nova-compute[75071]:       <nova:owner>
Nov 29 13:36:23 user nova-compute[75071]:         <nova:user uuid="f902428dcca045ffa81dbd8fd53048b6">tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member</nova:user>
Nov 29 13:36:23 user nova-compute[75071]:         <nova:project uuid="ecd1e8292884439b8d49dd698bf812e1">tempest-ServerBootFromVolumeStableRescueTest-398011867</nova:project>
Nov 29 13:36:23 user nova-compute[75071]:       </nova:owner>
Nov 29 13:36:23 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:36:23 user nova-compute[75071]:       <nova:ports>
Nov 29 13:36:23 user nova-compute[75071]:         <nova:port uuid="8a52ed97-212a-42ce-9462-843bda80dfa0">
Nov 29 13:36:23 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 13:36:23 user nova-compute[75071]:         </nova:port>
Nov 29 13:36:23 user nova-compute[75071]:       </nova:ports>
Nov 29 13:36:23 user nova-compute[75071]:     </nova:instance>
Nov 29 13:36:23 user nova-compute[75071]:   </metadata>
Nov 29 13:36:23 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:36:23 user nova-compute[75071]:     <system>
Nov 29 13:36:23 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:36:23 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:36:23 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:36:23 user nova-compute[75071]:       <entry name="serial">6a2550b8-269a-4cfb-887b-a3f3745812a1</entry>
Nov 29 13:36:23 user nova-compute[75071]:       <entry name="uuid">6a2550b8-269a-4cfb-887b-a3f3745812a1</entry>
Nov 29 13:36:23 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:36:23 user nova-compute[75071]:     </system>
Nov 29 13:36:23 user nova-compute[75071]:   </sysinfo>
Nov 29 13:36:23 user nova-compute[75071]:   <os>
Nov 29 13:36:23 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:36:23 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:36:23 user nova-compute[75071]:   </os>
Nov 29 13:36:23 user nova-compute[75071]:   <features>
Nov 29 13:36:23 user nova-compute[75071]:     <acpi/>
Nov 29 13:36:23 user nova-compute[75071]:     <apic/>
Nov 29 13:36:23 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:36:23 user nova-compute[75071]:   </features>
Nov 29 13:36:23 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:36:23 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:36:23 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:36:23 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:36:23 user nova-compute[75071]:   </clock>
Nov 29 13:36:23 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:36:23 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:36:23 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:36:23 user nova-compute[75071]:   </cpu>
Nov 29 13:36:23 user nova-compute[75071]:   <devices>
Nov 29 13:36:23 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:36:23 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:36:23 user nova-compute[75071]:       <source dev="/dev/sde"/>
Nov 29 13:36:23 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:36:23 user nova-compute[75071]:       <serial>f230d135-cd25-43ac-a400-03ebd6fd03fb</serial>
Nov 29 13:36:23 user nova-compute[75071]:     </disk>
Nov 29 13:36:23 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:36:23 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:36:23 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue"/>
Nov 29 13:36:23 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:36:23 user nova-compute[75071]:       <boot order="1"/>
Nov 29 13:36:23 user nova-compute[75071]:     </disk>
Nov 29 13:36:23 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:36:23 user nova-compute[75071]:       <mac address="fa:16:3e:4d:19:86"/>
Nov 29 13:36:23 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:36:23 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:36:23 user nova-compute[75071]:       <target dev="tap8a52ed97-21"/>
Nov 29 13:36:23 user nova-compute[75071]:     </interface>
Nov 29 13:36:23 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:36:23 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/console.log" append="off"/>
Nov 29 13:36:23 user nova-compute[75071]:     </serial>
Nov 29 13:36:23 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:36:23 user nova-compute[75071]:     <video>
Nov 29 13:36:23 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:36:23 user nova-compute[75071]:     </video>
Nov 29 13:36:23 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:36:23 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:36:23 user nova-compute[75071]:     </rng>
Nov 29 13:36:23 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:36:23 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:36:23 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:36:23 user nova-compute[75071]:     </memballoon>
Nov 29 13:36:23 user nova-compute[75071]:   </devices>
Nov 29 13:36:23 user nova-compute[75071]: </domain>
Nov 29 13:36:23 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-324fea8a-f29e-4668-9e60-720dba8459d2 req-5af82921-e167-457f-a066-434e899acdb9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Received event network-vif-deleted-f4114f62-6b07-4f02-9663-f1095f018f53 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:23 user nova-compute[75071]: INFO nova.compute.manager [req-324fea8a-f29e-4668-9e60-720dba8459d2 req-5af82921-e167-457f-a066-434e899acdb9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Neutron deleted interface f4114f62-6b07-4f02-9663-f1095f018f53; detaching it from the instance and deleting it from the info cache
Nov 29 13:36:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-324fea8a-f29e-4668-9e60-720dba8459d2 req-5af82921-e167-457f-a066-434e899acdb9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:24 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance destroyed successfully.
Nov 29 13:36:24 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Took 0.74 seconds to deallocate network for instance.
Nov 29 13:36:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-324fea8a-f29e-4668-9e60-720dba8459d2 req-5af82921-e167-457f-a066-434e899acdb9 service nova] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Detach interface failed, port_id=f4114f62-6b07-4f02-9663-f1095f018f53, reason: Instance b6ed42c9-2b8c-4f2a-930e-81ba854778be could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:36:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:36:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:36:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] No VIF found with MAC fa:16:3e:4d:19:86, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:36:24 user nova-compute[75071]: INFO nova.compute.manager [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Took 0.83 seconds to detach 1 volumes for instance.
Nov 29 13:36:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: b6ed42c9-2b8c-4f2a-930e-81ba854778be] Deleting volume: 94c1cb08-422b-4ed9-a6a1-dc0c6b9f81f7 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:25 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Deleted allocations for instance b6ed42c9-2b8c-4f2a-930e-81ba854778be
Nov 29 13:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c6ebd6b3-21c9-4f49-a3ce-de903a027b7d tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "b6ed42c9-2b8c-4f2a-930e-81ba854778be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.155s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b158c62-5964-47da-bc78-b633081189f3 req-d259fdc2-f65a-4463-8547-e570311852ad service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b158c62-5964-47da-bc78-b633081189f3 req-d259fdc2-f65a-4463-8547-e570311852ad service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b158c62-5964-47da-bc78-b633081189f3 req-d259fdc2-f65a-4463-8547-e570311852ad service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b158c62-5964-47da-bc78-b633081189f3 req-d259fdc2-f65a-4463-8547-e570311852ad service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b158c62-5964-47da-bc78-b633081189f3 req-d259fdc2-f65a-4463-8547-e570311852ad service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:25 user nova-compute[75071]: WARNING nova.compute.manager [req-1b158c62-5964-47da-bc78-b633081189f3 req-d259fdc2-f65a-4463-8547-e570311852ad service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state active and task_state rescuing.
Nov 29 13:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 -F raw /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk" returned: 0 in 2.151s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Ensure instance console log exists: /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Start _get_guest_xml network_info=[{"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6ca7d58b1589923dcb67b3347854338d',container_format='bare',created_at=2023-11-29T13:34:26Z,direct_url=<?>,disk_format='qcow2',id=d2097cb5-9a77-45fb-a4df-c3014195356f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-468125726-shelved',owner='c34bfa3e9f6b47beb18fb97da4bfb176',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T13:34:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:36:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:36:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6ca7d58b1589923dcb67b3347854338d',container_format='bare',created_at=2023-11-29T13:34:26Z,direct_url=<?>,disk_format='qcow2',id=d2097cb5-9a77-45fb-a4df-c3014195356f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-468125726-shelved',owner='c34bfa3e9f6b47beb18fb97da4bfb176',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T13:34:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.objects.base [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<9f62ede8-a1ed-411a-9720-b187674f974f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-468125726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-468125726',id=32,image_ref='d2097cb5-9a77-45fb-a4df-c3014195356f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1169509056',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:32:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-7ikhq3le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member',shelved_at='2023-11-29T13:34:30.367637',shelved_host='user',shelved_image_id='d2097cb5-9a77-45fb-a4df-c3014195356f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=9f62ede8-a1ed-411a-9720-b187674f974f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.objects.base [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Object Instance<9f62ede8-a1ed-411a-9720-b187674f974f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:36:26 user nova-compute[75071]:   <uuid>9f62ede8-a1ed-411a-9720-b187674f974f</uuid>
Nov 29 13:36:26 user nova-compute[75071]:   <name>instance-00000020</name>
Nov 29 13:36:26 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:36:26 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:36:26 user nova-compute[75071]:   <metadata>
Nov 29 13:36:26 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:36:26 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:36:26 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-468125726</nova:name>
Nov 29 13:36:26 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:36:26</nova:creationTime>
Nov 29 13:36:26 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:36:26 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:36:26 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:36:26 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:36:26 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:36:26 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:36:26 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:36:26 user nova-compute[75071]:       <nova:owner>
Nov 29 13:36:26 user nova-compute[75071]:         <nova:user uuid="013770deb90c4a83a4a822afdc45a2b9">tempest-AttachVolumeShelveTestJSON-2031472443-project-member</nova:user>
Nov 29 13:36:26 user nova-compute[75071]:         <nova:project uuid="c34bfa3e9f6b47beb18fb97da4bfb176">tempest-AttachVolumeShelveTestJSON-2031472443</nova:project>
Nov 29 13:36:26 user nova-compute[75071]:       </nova:owner>
Nov 29 13:36:26 user nova-compute[75071]:       <nova:root type="image" uuid="d2097cb5-9a77-45fb-a4df-c3014195356f"/>
Nov 29 13:36:26 user nova-compute[75071]:       <nova:ports>
Nov 29 13:36:26 user nova-compute[75071]:         <nova:port uuid="8a523b75-f9bb-49e1-bca9-a09400acd9ab">
Nov 29 13:36:26 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 13:36:26 user nova-compute[75071]:         </nova:port>
Nov 29 13:36:26 user nova-compute[75071]:       </nova:ports>
Nov 29 13:36:26 user nova-compute[75071]:     </nova:instance>
Nov 29 13:36:26 user nova-compute[75071]:   </metadata>
Nov 29 13:36:26 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:36:26 user nova-compute[75071]:     <system>
Nov 29 13:36:26 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:36:26 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:36:26 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:36:26 user nova-compute[75071]:       <entry name="serial">9f62ede8-a1ed-411a-9720-b187674f974f</entry>
Nov 29 13:36:26 user nova-compute[75071]:       <entry name="uuid">9f62ede8-a1ed-411a-9720-b187674f974f</entry>
Nov 29 13:36:26 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:36:26 user nova-compute[75071]:     </system>
Nov 29 13:36:26 user nova-compute[75071]:   </sysinfo>
Nov 29 13:36:26 user nova-compute[75071]:   <os>
Nov 29 13:36:26 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:36:26 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:36:26 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:36:26 user nova-compute[75071]:   </os>
Nov 29 13:36:26 user nova-compute[75071]:   <features>
Nov 29 13:36:26 user nova-compute[75071]:     <acpi/>
Nov 29 13:36:26 user nova-compute[75071]:     <apic/>
Nov 29 13:36:26 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:36:26 user nova-compute[75071]:   </features>
Nov 29 13:36:26 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:36:26 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:36:26 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:36:26 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:36:26 user nova-compute[75071]:   </clock>
Nov 29 13:36:26 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:36:26 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:36:26 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:36:26 user nova-compute[75071]:   </cpu>
Nov 29 13:36:26 user nova-compute[75071]:   <devices>
Nov 29 13:36:26 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:36:26 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:36:26 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk"/>
Nov 29 13:36:26 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:36:26 user nova-compute[75071]:     </disk>
Nov 29 13:36:26 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:36:26 user nova-compute[75071]:       <mac address="fa:16:3e:cb:ff:c3"/>
Nov 29 13:36:26 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:36:26 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:36:26 user nova-compute[75071]:       <target dev="tap8a523b75-f9"/>
Nov 29 13:36:26 user nova-compute[75071]:     </interface>
Nov 29 13:36:26 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:36:26 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/console.log" append="off"/>
Nov 29 13:36:26 user nova-compute[75071]:     </serial>
Nov 29 13:36:26 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:36:26 user nova-compute[75071]:     <video>
Nov 29 13:36:26 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:36:26 user nova-compute[75071]:     </video>
Nov 29 13:36:26 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:36:26 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:36:26 user nova-compute[75071]:     </rng>
Nov 29 13:36:26 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:36:26 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:36:26 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:36:26 user nova-compute[75071]:     </memballoon>
Nov 29 13:36:26 user nova-compute[75071]:   </devices>
Nov 29 13:36:26 user nova-compute[75071]: </domain>
Nov 29 13:36:26 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-468125726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-468125726',id=32,image_ref='d2097cb5-9a77-45fb-a4df-c3014195356f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1169509056',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:32:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-7ikhq3le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member',shelved_at='2023-11-29T13:34:30.367637',shelved_host='user',shelved_image_id='d2097cb5-9a77-45fb-a4df-c3014195356f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=9f62ede8-a1ed-411a-9720-b187674f974f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG os_vif [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fa2e5a0-0e8c-591b-8790-49e6376eda4f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a523b75-f9, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a523b75-f9, col_values=(('qos', UUID('b652d603-49e4-44c6-9e25-69fc3810b47d')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a523b75-f9, col_values=(('external_ids', {'iface-id': '8a523b75-f9bb-49e1-bca9-a09400acd9ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ff:c3', 'vm-uuid': '9f62ede8-a1ed-411a-9720-b187674f974f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:26 user nova-compute[75071]: INFO os_vif [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9')
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:36:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] No VIF found with MAC fa:16:3e:cb:ff:c3, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-a157bbc2-506b-47fb-af4e-d33965143ea0 req-8226ebc6-99db-4ae6-b3ff-c83cc3e49431 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a157bbc2-506b-47fb-af4e-d33965143ea0 req-8226ebc6-99db-4ae6-b3ff-c83cc3e49431 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a157bbc2-506b-47fb-af4e-d33965143ea0 req-8226ebc6-99db-4ae6-b3ff-c83cc3e49431 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a157bbc2-506b-47fb-af4e-d33965143ea0 req-8226ebc6-99db-4ae6-b3ff-c83cc3e49431 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-a157bbc2-506b-47fb-af4e-d33965143ea0 req-8226ebc6-99db-4ae6-b3ff-c83cc3e49431 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:27 user nova-compute[75071]: WARNING nova.compute.manager [req-a157bbc2-506b-47fb-af4e-d33965143ea0 req-8226ebc6-99db-4ae6-b3ff-c83cc3e49431 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state active and task_state rescuing.
Nov 29 13:36:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-37fd24fc-2a5d-4461-8480-c9f1032fd78c req-4f90b566-c431-42c0-84da-ef04c3f0e235 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-37fd24fc-2a5d-4461-8480-c9f1032fd78c req-4f90b566-c431-42c0-84da-ef04c3f0e235 service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-37fd24fc-2a5d-4461-8480-c9f1032fd78c req-4f90b566-c431-42c0-84da-ef04c3f0e235 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-37fd24fc-2a5d-4461-8480-c9f1032fd78c req-4f90b566-c431-42c0-84da-ef04c3f0e235 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-37fd24fc-2a5d-4461-8480-c9f1032fd78c req-4f90b566-c431-42c0-84da-ef04c3f0e235 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:27 user nova-compute[75071]: WARNING nova.compute.manager [req-37fd24fc-2a5d-4461-8480-c9f1032fd78c req-4f90b566-c431-42c0-84da-ef04c3f0e235 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received unexpected event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 13:36:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bf0f2847-5e2b-4510-9b2b-a221c0f1bf2c tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:36:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-b9369e91-8553-41af-a2f2-c04c4816cc61 req-80bd5b88-641b-43eb-86bc-721439ff5f60 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b9369e91-8553-41af-a2f2-c04c4816cc61 req-80bd5b88-641b-43eb-86bc-721439ff5f60 service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b9369e91-8553-41af-a2f2-c04c4816cc61 req-80bd5b88-641b-43eb-86bc-721439ff5f60 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b9369e91-8553-41af-a2f2-c04c4816cc61 req-80bd5b88-641b-43eb-86bc-721439ff5f60 service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-b9369e91-8553-41af-a2f2-c04c4816cc61 req-80bd5b88-641b-43eb-86bc-721439ff5f60 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:29 user nova-compute[75071]: WARNING nova.compute.manager [req-b9369e91-8553-41af-a2f2-c04c4816cc61 req-80bd5b88-641b-43eb-86bc-721439ff5f60 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received unexpected event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 13:36:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:36:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:36:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance spawned successfully.
Nov 29 13:36:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:36:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-99010d18-72cf-4037-9813-a062d1dcc280 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.984s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:36:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:36:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:54 user nova-compute[75071]: INFO nova.compute.manager [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Terminating instance
Nov 29 13:36:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6d68792-791c-4868-94f5-9a106f210659 req-41c6b9d7-2f82-4574-9911-c541f9991083 service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-vif-unplugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6d68792-791c-4868-94f5-9a106f210659 req-41c6b9d7-2f82-4574-9911-c541f9991083 service nova] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6d68792-791c-4868-94f5-9a106f210659 req-41c6b9d7-2f82-4574-9911-c541f9991083 service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c6d68792-791c-4868-94f5-9a106f210659 req-41c6b9d7-2f82-4574-9911-c541f9991083 service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6d68792-791c-4868-94f5-9a106f210659 req-41c6b9d7-2f82-4574-9911-c541f9991083 service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] No waiting events found dispatching network-vif-unplugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-c6d68792-791c-4868-94f5-9a106f210659 req-41c6b9d7-2f82-4574-9911-c541f9991083 service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-vif-unplugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Instance destroyed successfully.
Nov 29 13:36:55 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lazy-loading 'resources' on Instance uuid 64806dd7-0adb-4bb2-954a-707928115ce9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1302070337',display_name='tempest-ServerActionsTestOtherA-server-1302070337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1302070337',id=2,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvTPV0s2sU5++oYTzO4IMQsho67V6yIZgoZMf5JaEj48QUQD7z9OImXsqD6vRdki0M1Iywcmz5B8DiAXzDwU4gnccVww1irbSnTaBQ57IvE1iISIEApgx0FauiVceNHgQ==',key_name='tempest-keypair-2052313078',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f5f5e7553949989e7fc90db828a0bd',ramdisk_id='',reservation_id='r-dkzredzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-611751521',owner_user_name='tempest-ServerActionsTestOtherA-611751521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8395b32f70af4fd782ad81a609e9f63a',uuid=64806dd7-0adb-4bb2-954a-707928115ce9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converting VIF {"id": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "address": "fa:16:3e:67:c4:63", "network": {"id": "21dc657c-77d2-454a-84d5-920be5e18a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507277039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f5f5e7553949989e7fc90db828a0bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4e3d926-2c", "ovs_interfaceid": "c4e3d926-2ca7-42cc-9a76-5bc4db72803e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:c4:63,bridge_name='br-int',has_traffic_filtering=True,id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e3d926-2c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG os_vif [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:c4:63,bridge_name='br-int',has_traffic_filtering=True,id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e3d926-2c') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4e3d926-2c, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc73df4d-813a-42c7-b8df-dbe6422eb37b) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:55 user nova-compute[75071]: INFO os_vif [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:c4:63,bridge_name='br-int',has_traffic_filtering=True,id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e,network=Network(21dc657c-77d2-454a-84d5-920be5e18a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4e3d926-2c')
Nov 29 13:36:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Deleting instance files /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9_del
Nov 29 13:36:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Deletion of /opt/stack/data/nova/instances/64806dd7-0adb-4bb2-954a-707928115ce9_del complete
Nov 29 13:36:55 user nova-compute[75071]: INFO nova.compute.manager [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 13:36:55 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:36:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-31a6c8a2-9620-4f97-a2b5-d8862c689072 req-dbb6bb1c-e57d-4743-b10c-ec4c8f788f8a service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-vif-deleted-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:56 user nova-compute[75071]: INFO nova.compute.manager [req-31a6c8a2-9620-4f97-a2b5-d8862c689072 req-dbb6bb1c-e57d-4743-b10c-ec4c8f788f8a service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Neutron deleted interface c4e3d926-2ca7-42cc-9a76-5bc4db72803e; detaching it from the instance and deleting it from the info cache
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-31a6c8a2-9620-4f97-a2b5-d8862c689072 req-dbb6bb1c-e57d-4743-b10c-ec4c8f788f8a service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:36:56 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Took 0.78 seconds to deallocate network for instance.
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-31a6c8a2-9620-4f97-a2b5-d8862c689072 req-dbb6bb1c-e57d-4743-b10c-ec4c8f788f8a service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Detach interface failed, port_id=c4e3d926-2ca7-42cc-9a76-5bc4db72803e, reason: Instance 64806dd7-0adb-4bb2-954a-707928115ce9 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:56 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Deleted allocations for instance 64806dd7-0adb-4bb2-954a-707928115ce9
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d3211d2-4cc7-4de1-ab18-9c3fcb7a62be tempest-ServerActionsTestOtherA-611751521 tempest-ServerActionsTestOtherA-611751521-project-member] Lock "64806dd7-0adb-4bb2-954a-707928115ce9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-261d8f22-4aca-4d8d-b8e4-7d4660537e7a req-9f7cea02-8262-4d81-a2ae-beb97f8ba16a service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received event network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-261d8f22-4aca-4d8d-b8e4-7d4660537e7a req-9f7cea02-8262-4d81-a2ae-beb97f8ba16a service nova] Acquiring lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-261d8f22-4aca-4d8d-b8e4-7d4660537e7a req-9f7cea02-8262-4d81-a2ae-beb97f8ba16a service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-261d8f22-4aca-4d8d-b8e4-7d4660537e7a req-9f7cea02-8262-4d81-a2ae-beb97f8ba16a service nova] Lock "64806dd7-0adb-4bb2-954a-707928115ce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-261d8f22-4aca-4d8d-b8e4-7d4660537e7a req-9f7cea02-8262-4d81-a2ae-beb97f8ba16a service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] No waiting events found dispatching network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:36:56 user nova-compute[75071]: WARNING nova.compute.manager [req-261d8f22-4aca-4d8d-b8e4-7d4660537e7a req-9f7cea02-8262-4d81-a2ae-beb97f8ba16a service nova] [instance: 64806dd7-0adb-4bb2-954a-707928115ce9] Received unexpected event network-vif-plugged-c4e3d926-2ca7-42cc-9a76-5bc4db72803e for instance with vm_state deleted and task_state None.
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:36:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:36:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8234MB free_disk=24.89666748046875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f9101862-4ab0-4973-84a7-411ab276084d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6a2550b8-269a-4cfb-887b-a3f3745812a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9f62ede8-a1ed-411a-9720-b187674f974f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:36:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:36:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:36:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:36:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:36:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:36:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:37:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updating instance_info_cache with network_info: [{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:37:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:37:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:37:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:37:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "39691897-8629-4f70-a9b0-bdca787876bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "39691897-8629-4f70-a9b0-bdca787876bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:37:22 user nova-compute[75071]: INFO nova.compute.claims [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Claim successful on node user
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:37:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.policy [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32b037a2bbef4090a2317bfeedd8e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b75ecae6764ce1801dbab6253ac6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:37:23 user nova-compute[75071]: INFO nova.virt.block_device [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Booting with volume 6c1e9956-7eeb-49b0-9cbd-9382e03fb135 at /dev/vda
Nov 29 13:37:23 user nova-compute[75071]: DEBUG os_brick.utils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3308c-61e7-4235-b1a0-53139fdaed00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5504e7a7-e5b4-45de-a93f-f2bdccb3e9b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[349dad71-5687-4e59-88ad-3e311759e2fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7662e1-a92b-431e-83bd-76fe3194f625]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:37:23 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:37:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf8c01-86e5-4e39-9b12-1c698da84596]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG os_brick.utils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Updating existing volume attachment record: a6969d8a-2e9c-4f44-b671-ab304231c283 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:37:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Successfully created port: 4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Successfully updated port: 4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquired lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-changed-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Refreshing instance network info cache due to event network-changed-4573816e-b49e-40c2-a8e4-24cdf8fd0852. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] Acquiring lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Updating instance_info_cache with network_info: [{"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Releasing lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Instance network_info: |[{"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] Acquired lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:37:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Refreshing network info cache for port 4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:37:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Updated VIF entry in instance network info cache for port 4573816e-b49e-40c2-a8e4-24cdf8fd0852. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:37:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Updating instance_info_cache with network_info: [{"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:37:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7cf20fab-7686-46fd-92df-4137a6e0dea5 req-05601a18-ce48-43db-bf1c-d4ca5d546019 service nova] Releasing lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:37:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:37:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:37:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:37:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Creating image(s)
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Ensure instance console log exists: /opt/stack/data/nova/instances/39691897-8629-4f70-a9b0-bdca787876bf/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Start _get_guest_xml network_info=[{"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39691897-8629-4f70-a9b0-bdca787876bf', 'attached_at': '', 'detached_at': '', 'volume_id': '6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'serial': '6c1e9956-7eeb-49b0-9cbd-9382e03fb135'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a6969d8a-2e9c-4f44-b671-ab304231c283', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:37:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:37:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:37:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:37:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:37:31 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[539c8940-619f-46a1-867c-b4e982aa58df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:37:31 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d1317-6727-49aa-9dbf-44022aada902]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135] added
Nov 29 13:37:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae23d1a-4fc9-4e0a-924d-9d2782fb9388]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[925c3cf0-e124-481a-aadd-21744bf56991]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGWFsolM {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGWFsolM" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac466f-69a1-433e-9250-3e3b10b14d0b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGWFsolM'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb66d521-9cd3-4a4d-a4b1-4b1bd679921a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce054e7-b3bd-41b7-b391-2a2e8ee12f56]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:37:31 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:37:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:37:31 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:37:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e547228c-a5e1-4a38-aba7-bbbae9700a86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]
Nov 29 13:37:31 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.
Nov 29 13:37:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aca3b9-3963-4af3-99ae-81b40ee31f88]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88a6961-c69f-4bcb-9391-8c60f9f5a0a6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:37:31 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:37:31 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:37:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:37:31 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:37:31 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:37:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee7e4da-d5d1-437c-92d1-bfe5fa27fbae]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:37:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23133643561343231', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133643561343231', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1636632971',display_name='tempest-TestVolumeBootPattern-server-1636632971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1636632971',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-6fkp8cou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:37:23Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=39691897-8629-4f70-a9b0-bdca787876bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e7:ca,bridge_name='br-int',has_traffic_filtering=True,id=4573816e-b49e-40c2-a8e4-24cdf8fd0852,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4573816e-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'pci_devices' on Instance uuid 39691897-8629-4f70-a9b0-bdca787876bf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:37:32 user nova-compute[75071]:   <uuid>39691897-8629-4f70-a9b0-bdca787876bf</uuid>
Nov 29 13:37:32 user nova-compute[75071]:   <name>instance-00000024</name>
Nov 29 13:37:32 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:37:32 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:37:32 user nova-compute[75071]:   <metadata>
Nov 29 13:37:32 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:37:32 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:37:32 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-1636632971</nova:name>
Nov 29 13:37:32 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:37:31</nova:creationTime>
Nov 29 13:37:32 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:37:32 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:37:32 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:37:32 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:37:32 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:37:32 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:37:32 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:37:32 user nova-compute[75071]:       <nova:owner>
Nov 29 13:37:32 user nova-compute[75071]:         <nova:user uuid="32b037a2bbef4090a2317bfeedd8e155">tempest-TestVolumeBootPattern-2055293783-project-member</nova:user>
Nov 29 13:37:32 user nova-compute[75071]:         <nova:project uuid="86b75ecae6764ce1801dbab6253ac6c4">tempest-TestVolumeBootPattern-2055293783</nova:project>
Nov 29 13:37:32 user nova-compute[75071]:       </nova:owner>
Nov 29 13:37:32 user nova-compute[75071]:       <nova:ports>
Nov 29 13:37:32 user nova-compute[75071]:         <nova:port uuid="4573816e-b49e-40c2-a8e4-24cdf8fd0852">
Nov 29 13:37:32 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 13:37:32 user nova-compute[75071]:         </nova:port>
Nov 29 13:37:32 user nova-compute[75071]:       </nova:ports>
Nov 29 13:37:32 user nova-compute[75071]:     </nova:instance>
Nov 29 13:37:32 user nova-compute[75071]:   </metadata>
Nov 29 13:37:32 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:37:32 user nova-compute[75071]:     <system>
Nov 29 13:37:32 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:37:32 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:37:32 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:37:32 user nova-compute[75071]:       <entry name="serial">39691897-8629-4f70-a9b0-bdca787876bf</entry>
Nov 29 13:37:32 user nova-compute[75071]:       <entry name="uuid">39691897-8629-4f70-a9b0-bdca787876bf</entry>
Nov 29 13:37:32 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:37:32 user nova-compute[75071]:     </system>
Nov 29 13:37:32 user nova-compute[75071]:   </sysinfo>
Nov 29 13:37:32 user nova-compute[75071]:   <os>
Nov 29 13:37:32 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:37:32 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:37:32 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:37:32 user nova-compute[75071]:   </os>
Nov 29 13:37:32 user nova-compute[75071]:   <features>
Nov 29 13:37:32 user nova-compute[75071]:     <acpi/>
Nov 29 13:37:32 user nova-compute[75071]:     <apic/>
Nov 29 13:37:32 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:37:32 user nova-compute[75071]:   </features>
Nov 29 13:37:32 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:37:32 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:37:32 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:37:32 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:37:32 user nova-compute[75071]:   </clock>
Nov 29 13:37:32 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:37:32 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:37:32 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:37:32 user nova-compute[75071]:   </cpu>
Nov 29 13:37:32 user nova-compute[75071]:   <devices>
Nov 29 13:37:32 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:37:32 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:37:32 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Nov 29 13:37:32 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:37:32 user nova-compute[75071]:       <serial>6c1e9956-7eeb-49b0-9cbd-9382e03fb135</serial>
Nov 29 13:37:32 user nova-compute[75071]:     </disk>
Nov 29 13:37:32 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:37:32 user nova-compute[75071]:       <mac address="fa:16:3e:c7:e7:ca"/>
Nov 29 13:37:32 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:37:32 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:37:32 user nova-compute[75071]:       <target dev="tap4573816e-b4"/>
Nov 29 13:37:32 user nova-compute[75071]:     </interface>
Nov 29 13:37:32 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:37:32 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/39691897-8629-4f70-a9b0-bdca787876bf/console.log" append="off"/>
Nov 29 13:37:32 user nova-compute[75071]:     </serial>
Nov 29 13:37:32 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:37:32 user nova-compute[75071]:     <video>
Nov 29 13:37:32 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:37:32 user nova-compute[75071]:     </video>
Nov 29 13:37:32 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:37:32 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:37:32 user nova-compute[75071]:     </rng>
Nov 29 13:37:32 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:37:32 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:37:32 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:37:32 user nova-compute[75071]:     </memballoon>
Nov 29 13:37:32 user nova-compute[75071]:   </devices>
Nov 29 13:37:32 user nova-compute[75071]: </domain>
Nov 29 13:37:32 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1636632971',display_name='tempest-TestVolumeBootPattern-server-1636632971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1636632971',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-6fkp8cou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:37:23Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=39691897-8629-4f70-a9b0-bdca787876bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e7:ca,bridge_name='br-int',has_traffic_filtering=True,id=4573816e-b49e-40c2-a8e4-24cdf8fd0852,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4573816e-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG os_vif [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e7:ca,bridge_name='br-int',has_traffic_filtering=True,id=4573816e-b49e-40c2-a8e4-24cdf8fd0852,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4573816e-b4') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03f48f2e-dbe5-562d-8a54-7677e68625ec', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4573816e-b4, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4573816e-b4, col_values=(('qos', UUID('f393b91a-645a-4234-b9b3-d03e06ef98db')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4573816e-b4, col_values=(('external_ids', {'iface-id': '4573816e-b49e-40c2-a8e4-24cdf8fd0852', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:e7:ca', 'vm-uuid': '39691897-8629-4f70-a9b0-bdca787876bf'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:32 user nova-compute[75071]: INFO os_vif [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e7:ca,bridge_name='br-int',has_traffic_filtering=True,id=4573816e-b49e-40c2-a8e4-24cdf8fd0852,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4573816e-b4')
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:37:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No VIF found with MAC fa:16:3e:c7:e7:ca, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:37:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-ccd2f5e0-26fd-4b18-aa92-2e3991bdf2c1 req-8490c267-5c0a-4d35-b70f-fe212458f26e service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ccd2f5e0-26fd-4b18-aa92-2e3991bdf2c1 req-8490c267-5c0a-4d35-b70f-fe212458f26e service nova] Acquiring lock "39691897-8629-4f70-a9b0-bdca787876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ccd2f5e0-26fd-4b18-aa92-2e3991bdf2c1 req-8490c267-5c0a-4d35-b70f-fe212458f26e service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ccd2f5e0-26fd-4b18-aa92-2e3991bdf2c1 req-8490c267-5c0a-4d35-b70f-fe212458f26e service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-ccd2f5e0-26fd-4b18-aa92-2e3991bdf2c1 req-8490c267-5c0a-4d35-b70f-fe212458f26e service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] No waiting events found dispatching network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:34 user nova-compute[75071]: WARNING nova.compute.manager [req-ccd2f5e0-26fd-4b18-aa92-2e3991bdf2c1 req-8490c267-5c0a-4d35-b70f-fe212458f26e service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received unexpected event network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 for instance with vm_state building and task_state spawning.
Nov 29 13:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c8b664b-49c3-44ff-a1c0-d280f852da09 req-be328b0c-9fa2-4a13-b4c2-1bad59900e50 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c8b664b-49c3-44ff-a1c0-d280f852da09 req-be328b0c-9fa2-4a13-b4c2-1bad59900e50 service nova] Acquiring lock "39691897-8629-4f70-a9b0-bdca787876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c8b664b-49c3-44ff-a1c0-d280f852da09 req-be328b0c-9fa2-4a13-b4c2-1bad59900e50 service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c8b664b-49c3-44ff-a1c0-d280f852da09 req-be328b0c-9fa2-4a13-b4c2-1bad59900e50 service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c8b664b-49c3-44ff-a1c0-d280f852da09 req-be328b0c-9fa2-4a13-b4c2-1bad59900e50 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] No waiting events found dispatching network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:36 user nova-compute[75071]: WARNING nova.compute.manager [req-4c8b664b-49c3-44ff-a1c0-d280f852da09 req-be328b0c-9fa2-4a13-b4c2-1bad59900e50 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received unexpected event network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 for instance with vm_state building and task_state spawning.
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:37:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Instance spawned successfully.
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:36 user nova-compute[75071]: INFO nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 29 13:37:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:37:36 user nova-compute[75071]: INFO nova.compute.manager [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Took 13.85 seconds to build instance.
Nov 29 13:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ae2c5d5c-886f-4b00-ad6a-0141ade215bb tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "39691897-8629-4f70-a9b0-bdca787876bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.970s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "b6bdb155-e37b-4b39-b202-a343a870a52f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:37:38 user nova-compute[75071]: INFO nova.compute.claims [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Claim successful on node user
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:37:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.policy [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb5e9e2b5adc49de9355b7a80eb741d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80aae2c977154745aec9e9463767dbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:37:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Creating image(s)
Nov 29 13:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "/opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "/opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.267s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk 1073741824" returned: 0 in 0.061s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Successfully created port: 865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:37:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Cannot resize image /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Ensure instance console log exists: /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Successfully updated port: 865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "refresh_cache-b6bdb155-e37b-4b39-b202-a343a870a52f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquired lock "refresh_cache-b6bdb155-e37b-4b39-b202-a343a870a52f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received event network-changed-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Refreshing instance network info cache due to event network-changed-865da7f3-f417-4bd6-9a71-95630093dd73. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] Acquiring lock "refresh_cache-b6bdb155-e37b-4b39-b202-a343a870a52f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Updating instance_info_cache with network_info: [{"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Releasing lock "refresh_cache-b6bdb155-e37b-4b39-b202-a343a870a52f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Instance network_info: |[{"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] Acquired lock "refresh_cache-b6bdb155-e37b-4b39-b202-a343a870a52f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Refreshing network info cache for port 865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Start _get_guest_xml network_info=[{"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:37:40 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:37:40 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-707358433',display_name='tempest-VolumesActionsTest-instance-707358433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-707358433',id=37,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80aae2c977154745aec9e9463767dbbb',ramdisk_id='',reservation_id='r-d2oakd6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1166636287',owner_user_name='tempest-VolumesActionsTest-1166636287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:37:39Z,user_data=None,user_id='fb5e9e2b5adc49de9355b7a80eb741d7',uuid=b6bdb155-e37b-4b39-b202-a343a870a52f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converting VIF {"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=865da7f3-f417-4bd6-9a71-95630093dd73,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865da7f3-f4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lazy-loading 'pci_devices' on Instance uuid b6bdb155-e37b-4b39-b202-a343a870a52f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:37:40 user nova-compute[75071]:   <uuid>b6bdb155-e37b-4b39-b202-a343a870a52f</uuid>
Nov 29 13:37:40 user nova-compute[75071]:   <name>instance-00000025</name>
Nov 29 13:37:40 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:37:40 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:37:40 user nova-compute[75071]:   <metadata>
Nov 29 13:37:40 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:37:40 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:37:40 user nova-compute[75071]:       <nova:name>tempest-VolumesActionsTest-instance-707358433</nova:name>
Nov 29 13:37:40 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:37:40</nova:creationTime>
Nov 29 13:37:40 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:37:40 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:37:40 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:37:40 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:37:40 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:37:40 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:37:40 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:37:40 user nova-compute[75071]:       <nova:owner>
Nov 29 13:37:40 user nova-compute[75071]:         <nova:user uuid="fb5e9e2b5adc49de9355b7a80eb741d7">tempest-VolumesActionsTest-1166636287-project-member</nova:user>
Nov 29 13:37:40 user nova-compute[75071]:         <nova:project uuid="80aae2c977154745aec9e9463767dbbb">tempest-VolumesActionsTest-1166636287</nova:project>
Nov 29 13:37:40 user nova-compute[75071]:       </nova:owner>
Nov 29 13:37:40 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:37:40 user nova-compute[75071]:       <nova:ports>
Nov 29 13:37:40 user nova-compute[75071]:         <nova:port uuid="865da7f3-f417-4bd6-9a71-95630093dd73">
Nov 29 13:37:40 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:37:40 user nova-compute[75071]:         </nova:port>
Nov 29 13:37:40 user nova-compute[75071]:       </nova:ports>
Nov 29 13:37:40 user nova-compute[75071]:     </nova:instance>
Nov 29 13:37:40 user nova-compute[75071]:   </metadata>
Nov 29 13:37:40 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:37:40 user nova-compute[75071]:     <system>
Nov 29 13:37:40 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:37:40 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:37:40 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:37:40 user nova-compute[75071]:       <entry name="serial">b6bdb155-e37b-4b39-b202-a343a870a52f</entry>
Nov 29 13:37:40 user nova-compute[75071]:       <entry name="uuid">b6bdb155-e37b-4b39-b202-a343a870a52f</entry>
Nov 29 13:37:40 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:37:40 user nova-compute[75071]:     </system>
Nov 29 13:37:40 user nova-compute[75071]:   </sysinfo>
Nov 29 13:37:40 user nova-compute[75071]:   <os>
Nov 29 13:37:40 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:37:40 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:37:40 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:37:40 user nova-compute[75071]:   </os>
Nov 29 13:37:40 user nova-compute[75071]:   <features>
Nov 29 13:37:40 user nova-compute[75071]:     <acpi/>
Nov 29 13:37:40 user nova-compute[75071]:     <apic/>
Nov 29 13:37:40 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:37:40 user nova-compute[75071]:   </features>
Nov 29 13:37:40 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:37:40 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:37:40 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:37:40 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:37:40 user nova-compute[75071]:   </clock>
Nov 29 13:37:40 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:37:40 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:37:40 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:37:40 user nova-compute[75071]:   </cpu>
Nov 29 13:37:40 user nova-compute[75071]:   <devices>
Nov 29 13:37:40 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:37:40 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:37:40 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk"/>
Nov 29 13:37:40 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:37:40 user nova-compute[75071]:     </disk>
Nov 29 13:37:40 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:37:40 user nova-compute[75071]:       <mac address="fa:16:3e:90:2c:fe"/>
Nov 29 13:37:40 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:37:40 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:37:40 user nova-compute[75071]:       <target dev="tap865da7f3-f4"/>
Nov 29 13:37:40 user nova-compute[75071]:     </interface>
Nov 29 13:37:40 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:37:40 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/console.log" append="off"/>
Nov 29 13:37:40 user nova-compute[75071]:     </serial>
Nov 29 13:37:40 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:37:40 user nova-compute[75071]:     <video>
Nov 29 13:37:40 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:37:40 user nova-compute[75071]:     </video>
Nov 29 13:37:40 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:37:40 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:37:40 user nova-compute[75071]:     </rng>
Nov 29 13:37:40 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:37:40 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:37:40 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:37:40 user nova-compute[75071]:     </memballoon>
Nov 29 13:37:40 user nova-compute[75071]:   </devices>
Nov 29 13:37:40 user nova-compute[75071]: </domain>
Nov 29 13:37:40 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-707358433',display_name='tempest-VolumesActionsTest-instance-707358433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-707358433',id=37,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80aae2c977154745aec9e9463767dbbb',ramdisk_id='',reservation_id='r-d2oakd6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1166636287',owner_user_name='tempest-VolumesActionsTest-1166636287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:37:39Z,user_data=None,user_id='fb5e9e2b5adc49de9355b7a80eb741d7',uuid=b6bdb155-e37b-4b39-b202-a343a870a52f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converting VIF {"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=865da7f3-f417-4bd6-9a71-95630093dd73,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865da7f3-f4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG os_vif [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=865da7f3-f417-4bd6-9a71-95630093dd73,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865da7f3-f4') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e538e99-4f3b-517c-baac-829108f26690', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap865da7f3-f4, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap865da7f3-f4, col_values=(('qos', UUID('a1ec7716-a45b-44b0-aea0-db0f56ced927')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap865da7f3-f4, col_values=(('external_ids', {'iface-id': '865da7f3-f417-4bd6-9a71-95630093dd73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:2c:fe', 'vm-uuid': 'b6bdb155-e37b-4b39-b202-a343a870a52f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:40 user nova-compute[75071]: INFO os_vif [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=865da7f3-f417-4bd6-9a71-95630093dd73,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865da7f3-f4')
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] No VIF found with MAC fa:16:3e:90:2c:fe, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:37:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Updated VIF entry in instance network info cache for port 865da7f3-f417-4bd6-9a71-95630093dd73. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:37:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Updating instance_info_cache with network_info: [{"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:37:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8fbdb28-7409-4b46-9198-7d80f44d189b req-f47754b5-1b9d-404b-bdaa-89db69c54af2 service nova] Releasing lock "refresh_cache-b6bdb155-e37b-4b39-b202-a343a870a52f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-07fb547f-99ab-4b7a-9641-af68247adbc7 req-b86283db-dab3-4e87-9190-fbe133c3e54f service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received event network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-07fb547f-99ab-4b7a-9641-af68247adbc7 req-b86283db-dab3-4e87-9190-fbe133c3e54f service nova] Acquiring lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-07fb547f-99ab-4b7a-9641-af68247adbc7 req-b86283db-dab3-4e87-9190-fbe133c3e54f service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-07fb547f-99ab-4b7a-9641-af68247adbc7 req-b86283db-dab3-4e87-9190-fbe133c3e54f service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-07fb547f-99ab-4b7a-9641-af68247adbc7 req-b86283db-dab3-4e87-9190-fbe133c3e54f service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] No waiting events found dispatching network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:42 user nova-compute[75071]: WARNING nova.compute.manager [req-07fb547f-99ab-4b7a-9641-af68247adbc7 req-b86283db-dab3-4e87-9190-fbe133c3e54f service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received unexpected event network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 for instance with vm_state building and task_state spawning.
Nov 29 13:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:37:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Instance spawned successfully.
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-87987aa8-2d23-4dc9-a447-3185a9112267 req-2c94a19f-e372-4416-8c93-4559e6f86fda service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received event network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-87987aa8-2d23-4dc9-a447-3185a9112267 req-2c94a19f-e372-4416-8c93-4559e6f86fda service nova] Acquiring lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-87987aa8-2d23-4dc9-a447-3185a9112267 req-2c94a19f-e372-4416-8c93-4559e6f86fda service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-87987aa8-2d23-4dc9-a447-3185a9112267 req-2c94a19f-e372-4416-8c93-4559e6f86fda service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-87987aa8-2d23-4dc9-a447-3185a9112267 req-2c94a19f-e372-4416-8c93-4559e6f86fda service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] No waiting events found dispatching network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:44 user nova-compute[75071]: WARNING nova.compute.manager [req-87987aa8-2d23-4dc9-a447-3185a9112267 req-2c94a19f-e372-4416-8c93-4559e6f86fda service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received unexpected event network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 for instance with vm_state building and task_state spawning.
Nov 29 13:37:44 user nova-compute[75071]: INFO nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 29 13:37:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:37:44 user nova-compute[75071]: INFO nova.compute.manager [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Took 6.35 seconds to build instance.
Nov 29 13:37:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d20a7477-14b3-48ec-a388-b5918b9456c5 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.476s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:45 user nova-compute[75071]: INFO nova.compute.manager [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Terminating instance
Nov 29 13:37:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-3d1313b4-02bc-4d8e-91c4-5027f0ebdccc req-1af53697-0b34-4946-b865-5738ad3a364b service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3d1313b4-02bc-4d8e-91c4-5027f0ebdccc req-1af53697-0b34-4946-b865-5738ad3a364b service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3d1313b4-02bc-4d8e-91c4-5027f0ebdccc req-1af53697-0b34-4946-b865-5738ad3a364b service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3d1313b4-02bc-4d8e-91c4-5027f0ebdccc req-1af53697-0b34-4946-b865-5738ad3a364b service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-3d1313b4-02bc-4d8e-91c4-5027f0ebdccc req-1af53697-0b34-4946-b865-5738ad3a364b service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-3d1313b4-02bc-4d8e-91c4-5027f0ebdccc req-1af53697-0b34-4946-b865-5738ad3a364b service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Instance destroyed successfully.
Nov 29 13:37:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'resources' on Instance uuid f9101862-4ab0-4973-84a7-411ab276084d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:27:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-489273326',display_name='tempest-AttachVolumeTestJSON-server-489273326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-489273326',id=25,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFippSy9RvqYWnF7NMVOzyIHyMK5UJ6+Apx1PF1Q049orzO4nXt+zOpcDzBs5URwpS1VPy6nVNux6R7CxJfc7qnaKCn33hu10N+3iYVgj3Mntu+aLkd4hqN/jb0gJrfzw==',key_name='tempest-keypair-1314365902',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:28:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-tsh0qttu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:35:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=f9101862-4ab0-4973-84a7-411ab276084d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "address": "fa:16:3e:a4:e6:92", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2c6093-ff", "ovs_interfaceid": "2a2c6093-ffca-45b4-95f9-b612afba26a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG os_vif [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a2c6093-ff, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b16cab1b-a347-4ba8-b769-27f38482b03d) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:37:46 user nova-compute[75071]: INFO os_vif [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:e6:92,bridge_name='br-int',has_traffic_filtering=True,id=2a2c6093-ffca-45b4-95f9-b612afba26a5,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2c6093-ff')
Nov 29 13:37:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Deleting instance files /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d_del
Nov 29 13:37:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Deletion of /opt/stack/data/nova/instances/f9101862-4ab0-4973-84a7-411ab276084d_del complete
Nov 29 13:37:46 user nova-compute[75071]: INFO nova.compute.manager [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 13:37:46 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:37:47 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Took 1.19 seconds to deallocate network for instance.
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-06556ce5-32f0-4e2d-b154-3efd537df069 req-384219f5-4753-41b9-8b2a-cf950ea91521 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-deleted-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:47 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Deleted allocations for instance f9101862-4ab0-4973-84a7-411ab276084d
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:47 user nova-compute[75071]: WARNING nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state deleted and task_state None.
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:47 user nova-compute[75071]: WARNING nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state deleted and task_state None.
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:47 user nova-compute[75071]: WARNING nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state deleted and task_state None.
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:47 user nova-compute[75071]: WARNING nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-unplugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state deleted and task_state None.
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Acquiring lock "f9101862-4ab0-4973-84a7-411ab276084d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] Lock "f9101862-4ab0-4973-84a7-411ab276084d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] No waiting events found dispatching network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:37:47 user nova-compute[75071]: WARNING nova.compute.manager [req-ba980088-d039-4e6e-b8a5-1b7ae5fae2c8 req-e1223044-3fc3-470e-b78a-b0986b90d826 service nova] [instance: f9101862-4ab0-4973-84a7-411ab276084d] Received unexpected event network-vif-plugged-2a2c6093-ffca-45b4-95f9-b612afba26a5 for instance with vm_state deleted and task_state None.
Nov 29 13:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3bf8d65b-52e4-4c75-b29a-b4f546e55621 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "f9101862-4ab0-4973-84a7-411ab276084d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.573s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:37:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:37:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:37:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:37:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:37:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:37:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:37:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8145MB free_disk=24.89459991455078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6a2550b8-269a-4cfb-887b-a3f3745812a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9f62ede8-a1ed-411a-9720-b187674f974f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 39691897-8629-4f70-a9b0-bdca787876bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b6bdb155-e37b-4b39-b202-a343a870a52f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:37:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.309s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:37:59 user nova-compute[75071]: INFO nova.compute.claims [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Claim successful on node user
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.196s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:37:59 user nova-compute[75071]: INFO nova.compute.claims [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Claim successful on node user
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:37:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.policy [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2457f7d6a4f64d2d94a542d73403814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02fdf8ccfd7b4320b9422fd1145705cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:37:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Creating image(s)
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk 1073741824" returned: 0 in 0.063s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:38:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Successfully created port: 251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.policy [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2457f7d6a4f64d2d94a542d73403814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02fdf8ccfd7b4320b9422fd1145705cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:38:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Creating image(s)
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Cannot resize image /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Ensure instance console log exists: /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating instance_info_cache with network_info: [{"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk 1073741824" returned: 0 in 0.054s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Successfully created port: a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Successfully updated port: 251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-changed-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Refreshing instance network info cache due to event network-changed-251cf287-d635-477f-bc23-f0d8e8f1483d. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Cannot resize image /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Ensure instance console log exists: /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance network_info: |[{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Refreshing network info cache for port 251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Start _get_guest_xml network_info=[{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:38:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:38:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2062987681',display_name='tempest-ServerRescueNegativeTestJSON-server-2062987681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2062987681',id=38,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-oj39li58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:00Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:38:01 user nova-compute[75071]:   <uuid>7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce</uuid>
Nov 29 13:38:01 user nova-compute[75071]:   <name>instance-00000026</name>
Nov 29 13:38:01 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:38:01 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:38:01 user nova-compute[75071]:   <metadata>
Nov 29 13:38:01 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:38:01 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:38:01 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2062987681</nova:name>
Nov 29 13:38:01 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:38:01</nova:creationTime>
Nov 29 13:38:01 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:38:01 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:38:01 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:38:01 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:38:01 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:38:01 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:38:01 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:38:01 user nova-compute[75071]:       <nova:owner>
Nov 29 13:38:01 user nova-compute[75071]:         <nova:user uuid="2457f7d6a4f64d2d94a542d73403814f">tempest-ServerRescueNegativeTestJSON-904604817-project-member</nova:user>
Nov 29 13:38:01 user nova-compute[75071]:         <nova:project uuid="02fdf8ccfd7b4320b9422fd1145705cb">tempest-ServerRescueNegativeTestJSON-904604817</nova:project>
Nov 29 13:38:01 user nova-compute[75071]:       </nova:owner>
Nov 29 13:38:01 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:38:01 user nova-compute[75071]:       <nova:ports>
Nov 29 13:38:01 user nova-compute[75071]:         <nova:port uuid="251cf287-d635-477f-bc23-f0d8e8f1483d">
Nov 29 13:38:01 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:38:01 user nova-compute[75071]:         </nova:port>
Nov 29 13:38:01 user nova-compute[75071]:       </nova:ports>
Nov 29 13:38:01 user nova-compute[75071]:     </nova:instance>
Nov 29 13:38:01 user nova-compute[75071]:   </metadata>
Nov 29 13:38:01 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:38:01 user nova-compute[75071]:     <system>
Nov 29 13:38:01 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:38:01 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:38:01 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:38:01 user nova-compute[75071]:       <entry name="serial">7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce</entry>
Nov 29 13:38:01 user nova-compute[75071]:       <entry name="uuid">7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce</entry>
Nov 29 13:38:01 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:38:01 user nova-compute[75071]:     </system>
Nov 29 13:38:01 user nova-compute[75071]:   </sysinfo>
Nov 29 13:38:01 user nova-compute[75071]:   <os>
Nov 29 13:38:01 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:38:01 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:38:01 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:38:01 user nova-compute[75071]:   </os>
Nov 29 13:38:01 user nova-compute[75071]:   <features>
Nov 29 13:38:01 user nova-compute[75071]:     <acpi/>
Nov 29 13:38:01 user nova-compute[75071]:     <apic/>
Nov 29 13:38:01 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:38:01 user nova-compute[75071]:   </features>
Nov 29 13:38:01 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:38:01 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:38:01 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:38:01 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:38:01 user nova-compute[75071]:   </clock>
Nov 29 13:38:01 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:38:01 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:38:01 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:38:01 user nova-compute[75071]:   </cpu>
Nov 29 13:38:01 user nova-compute[75071]:   <devices>
Nov 29 13:38:01 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:38:01 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:38:01 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk"/>
Nov 29 13:38:01 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:38:01 user nova-compute[75071]:     </disk>
Nov 29 13:38:01 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:38:01 user nova-compute[75071]:       <mac address="fa:16:3e:6d:d0:f9"/>
Nov 29 13:38:01 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:38:01 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:38:01 user nova-compute[75071]:       <target dev="tap251cf287-d6"/>
Nov 29 13:38:01 user nova-compute[75071]:     </interface>
Nov 29 13:38:01 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:38:01 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/console.log" append="off"/>
Nov 29 13:38:01 user nova-compute[75071]:     </serial>
Nov 29 13:38:01 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:38:01 user nova-compute[75071]:     <video>
Nov 29 13:38:01 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:38:01 user nova-compute[75071]:     </video>
Nov 29 13:38:01 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:38:01 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:38:01 user nova-compute[75071]:     </rng>
Nov 29 13:38:01 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:38:01 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:38:01 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:38:01 user nova-compute[75071]:     </memballoon>
Nov 29 13:38:01 user nova-compute[75071]:   </devices>
Nov 29 13:38:01 user nova-compute[75071]: </domain>
Nov 29 13:38:01 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2062987681',display_name='tempest-ServerRescueNegativeTestJSON-server-2062987681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2062987681',id=38,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-oj39li58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:00Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG os_vif [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ec78349-962a-5740-911b-200c1eadde18', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap251cf287-d6, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap251cf287-d6, col_values=(('qos', UUID('ef25ac7f-e286-4674-bd7e-f2786bb5cb60')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap251cf287-d6, col_values=(('external_ids', {'iface-id': '251cf287-d635-477f-bc23-f0d8e8f1483d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:d0:f9', 'vm-uuid': '7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:01 user nova-compute[75071]: INFO os_vif [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6')
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No VIF found with MAC fa:16:3e:6d:d0:f9, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Successfully updated port: a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-changed-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Refreshing instance network info cache due to event network-changed-a37a280d-e37b-419f-9a2f-42c32508a1c0. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] Acquiring lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updated VIF entry in instance network info cache for port 251cf287-d635-477f-bc23-f0d8e8f1483d. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e70ba70f-bae8-461a-baae-02d784a99aba req-026be7ad-9522-4d2a-876a-b43b216537f0 service nova] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance network_info: |[{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] Acquired lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Refreshing network info cache for port a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Start _get_guest_xml network_info=[{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:38:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:38:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-956692139',display_name='tempest-ServerRescueNegativeTestJSON-server-956692139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-956692139',id=39,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-82978qtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:01Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=53f642bd-5e9a-4c9d-a866-26eeaf4c465f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'pci_devices' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:38:02 user nova-compute[75071]:   <uuid>53f642bd-5e9a-4c9d-a866-26eeaf4c465f</uuid>
Nov 29 13:38:02 user nova-compute[75071]:   <name>instance-00000027</name>
Nov 29 13:38:02 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:38:02 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:38:02 user nova-compute[75071]:   <metadata>
Nov 29 13:38:02 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:38:02 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:38:02 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-956692139</nova:name>
Nov 29 13:38:02 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:38:02</nova:creationTime>
Nov 29 13:38:02 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:38:02 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:38:02 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:38:02 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:38:02 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:38:02 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:38:02 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:38:02 user nova-compute[75071]:       <nova:owner>
Nov 29 13:38:02 user nova-compute[75071]:         <nova:user uuid="2457f7d6a4f64d2d94a542d73403814f">tempest-ServerRescueNegativeTestJSON-904604817-project-member</nova:user>
Nov 29 13:38:02 user nova-compute[75071]:         <nova:project uuid="02fdf8ccfd7b4320b9422fd1145705cb">tempest-ServerRescueNegativeTestJSON-904604817</nova:project>
Nov 29 13:38:02 user nova-compute[75071]:       </nova:owner>
Nov 29 13:38:02 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:38:02 user nova-compute[75071]:       <nova:ports>
Nov 29 13:38:02 user nova-compute[75071]:         <nova:port uuid="a37a280d-e37b-419f-9a2f-42c32508a1c0">
Nov 29 13:38:02 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 13:38:02 user nova-compute[75071]:         </nova:port>
Nov 29 13:38:02 user nova-compute[75071]:       </nova:ports>
Nov 29 13:38:02 user nova-compute[75071]:     </nova:instance>
Nov 29 13:38:02 user nova-compute[75071]:   </metadata>
Nov 29 13:38:02 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:38:02 user nova-compute[75071]:     <system>
Nov 29 13:38:02 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:38:02 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:38:02 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:38:02 user nova-compute[75071]:       <entry name="serial">53f642bd-5e9a-4c9d-a866-26eeaf4c465f</entry>
Nov 29 13:38:02 user nova-compute[75071]:       <entry name="uuid">53f642bd-5e9a-4c9d-a866-26eeaf4c465f</entry>
Nov 29 13:38:02 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:38:02 user nova-compute[75071]:     </system>
Nov 29 13:38:02 user nova-compute[75071]:   </sysinfo>
Nov 29 13:38:02 user nova-compute[75071]:   <os>
Nov 29 13:38:02 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:38:02 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:38:02 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:38:02 user nova-compute[75071]:   </os>
Nov 29 13:38:02 user nova-compute[75071]:   <features>
Nov 29 13:38:02 user nova-compute[75071]:     <acpi/>
Nov 29 13:38:02 user nova-compute[75071]:     <apic/>
Nov 29 13:38:02 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:38:02 user nova-compute[75071]:   </features>
Nov 29 13:38:02 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:38:02 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:38:02 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:38:02 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:38:02 user nova-compute[75071]:   </clock>
Nov 29 13:38:02 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:38:02 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:38:02 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:38:02 user nova-compute[75071]:   </cpu>
Nov 29 13:38:02 user nova-compute[75071]:   <devices>
Nov 29 13:38:02 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:38:02 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:38:02 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk"/>
Nov 29 13:38:02 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:38:02 user nova-compute[75071]:     </disk>
Nov 29 13:38:02 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:38:02 user nova-compute[75071]:       <mac address="fa:16:3e:6a:be:95"/>
Nov 29 13:38:02 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:38:02 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:38:02 user nova-compute[75071]:       <target dev="tapa37a280d-e3"/>
Nov 29 13:38:02 user nova-compute[75071]:     </interface>
Nov 29 13:38:02 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:38:02 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/console.log" append="off"/>
Nov 29 13:38:02 user nova-compute[75071]:     </serial>
Nov 29 13:38:02 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:38:02 user nova-compute[75071]:     <video>
Nov 29 13:38:02 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:38:02 user nova-compute[75071]:     </video>
Nov 29 13:38:02 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:38:02 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:38:02 user nova-compute[75071]:     </rng>
Nov 29 13:38:02 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:38:02 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:38:02 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:38:02 user nova-compute[75071]:     </memballoon>
Nov 29 13:38:02 user nova-compute[75071]:   </devices>
Nov 29 13:38:02 user nova-compute[75071]: </domain>
Nov 29 13:38:02 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-956692139',display_name='tempest-ServerRescueNegativeTestJSON-server-956692139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-956692139',id=39,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-82978qtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:01Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=53f642bd-5e9a-4c9d-a866-26eeaf4c465f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG os_vif [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a47e6db-e0e9-539f-86ae-902a12e20d23', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa37a280d-e3, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa37a280d-e3, col_values=(('qos', UUID('95422075-c238-491e-a9d9-416a536c2de4')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa37a280d-e3, col_values=(('external_ids', {'iface-id': 'a37a280d-e37b-419f-9a2f-42c32508a1c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:be:95', 'vm-uuid': '53f642bd-5e9a-4c9d-a866-26eeaf4c465f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:02 user nova-compute[75071]: INFO os_vif [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3')
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No VIF found with MAC fa:16:3e:6a:be:95, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updated VIF entry in instance network info cache for port a37a280d-e37b-419f-9a2f-42c32508a1c0. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-df229d53-db5d-46bd-a311-f3b7c616a071 req-aa884eec-14e6-4bac-8918-35b879e9daa1 service nova] Releasing lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-09149ab7-50cc-4ee7-a802-4554109e6478 req-c20f4e14-7c4d-4125-81b7-0504dc602b9d service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-09149ab7-50cc-4ee7-a802-4554109e6478 req-c20f4e14-7c4d-4125-81b7-0504dc602b9d service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-09149ab7-50cc-4ee7-a802-4554109e6478 req-c20f4e14-7c4d-4125-81b7-0504dc602b9d service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-09149ab7-50cc-4ee7-a802-4554109e6478 req-c20f4e14-7c4d-4125-81b7-0504dc602b9d service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-09149ab7-50cc-4ee7-a802-4554109e6478 req-c20f4e14-7c4d-4125-81b7-0504dc602b9d service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:03 user nova-compute[75071]: WARNING nova.compute.manager [req-09149ab7-50cc-4ee7-a802-4554109e6478 req-c20f4e14-7c4d-4125-81b7-0504dc602b9d service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state building and task_state spawning.
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:05 user nova-compute[75071]: WARNING nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state building and task_state spawning.
Nov 29 13:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:05 user nova-compute[75071]: WARNING nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received unexpected event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with vm_state building and task_state spawning.
Nov 29 13:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:05 user nova-compute[75071]: WARNING nova.compute.manager [req-64ed7eb0-24e4-4d26-b787-82798ef32e80 req-8c305d46-280f-488f-a661-d8f226e1b9e3 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received unexpected event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with vm_state building and task_state spawning.
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:38:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance spawned successfully.
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: INFO nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Took 6.76 seconds to spawn the instance on the hypervisor.
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:38:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance spawned successfully.
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:38:06 user nova-compute[75071]: INFO nova.compute.manager [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Took 8.05 seconds to build instance.
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-203b0fcd-f4c5-4aac-8f01-a8811c3e14f7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.155s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:06 user nova-compute[75071]: INFO nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 29 13:38:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:38:06 user nova-compute[75071]: INFO nova.compute.manager [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Took 7.49 seconds to build instance.
Nov 29 13:38:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cea268f-7502-4191-b0a8-a79add79c0ba tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.582s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:08 user nova-compute[75071]: INFO nova.compute.manager [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Terminating instance
Nov 29 13:38:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-8ad0c181-f305-4cd5-a1c2-585349e5a730 req-6b31a33a-f964-41ec-b357-df41646fcd7e service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-unplugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8ad0c181-f305-4cd5-a1c2-585349e5a730 req-6b31a33a-f964-41ec-b357-df41646fcd7e service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8ad0c181-f305-4cd5-a1c2-585349e5a730 req-6b31a33a-f964-41ec-b357-df41646fcd7e service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8ad0c181-f305-4cd5-a1c2-585349e5a730 req-6b31a33a-f964-41ec-b357-df41646fcd7e service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-8ad0c181-f305-4cd5-a1c2-585349e5a730 req-6b31a33a-f964-41ec-b357-df41646fcd7e service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-unplugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-8ad0c181-f305-4cd5-a1c2-585349e5a730 req-6b31a33a-f964-41ec-b357-df41646fcd7e service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-unplugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:38:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Instance destroyed successfully.
Nov 29 13:38:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lazy-loading 'resources' on Instance uuid 9f62ede8-a1ed-411a-9720-b187674f974f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T13:32:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-468125726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-468125726',id=32,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEnEvpwLVwhA6iy3tz3v3R0fiS+WPfBzsMVdWoYBaM9OSMZpIjrwyYVB6spM1rKu3nJ13UulkADDc7mLe20T6IE6LPZD26bH00I8jG21iN2Y4DIO4RBD8jJ5Jb70bo8+A==',key_name='tempest-keypair-1169509056',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34bfa3e9f6b47beb18fb97da4bfb176',ramdisk_id='',reservation_id='r-7ikhq3le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2031472443',owner_user_name='tempest-AttachVolumeShelveTestJSON-2031472443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:36:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='013770deb90c4a83a4a822afdc45a2b9',uuid=9f62ede8-a1ed-411a-9720-b187674f974f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converting VIF {"id": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "address": "fa:16:3e:cb:ff:c3", "network": {"id": "faf559e7-fe45-4fcb-9869-b3e2690e9893", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-610086970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bfa3e9f6b47beb18fb97da4bfb176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a523b75-f9", "ovs_interfaceid": "8a523b75-f9bb-49e1-bca9-a09400acd9ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG os_vif [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a523b75-f9, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b652d603-49e4-44c6-9e25-69fc3810b47d) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:09 user nova-compute[75071]: INFO os_vif [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a523b75-f9bb-49e1-bca9-a09400acd9ab,network=Network(faf559e7-fe45-4fcb-9869-b3e2690e9893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a523b75-f9')
Nov 29 13:38:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Deleting instance files /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f_del
Nov 29 13:38:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Deletion of /opt/stack/data/nova/instances/9f62ede8-a1ed-411a-9720-b187674f974f_del complete
Nov 29 13:38:09 user nova-compute[75071]: INFO nova.compute.manager [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 13:38:09 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:38:09 user nova-compute[75071]: INFO nova.compute.manager [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Unrescuing
Nov 29 13:38:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquired lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updating instance_info_cache with network_info: [{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Releasing lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'flavor' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:10 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Took 0.99 seconds to deallocate network for instance.
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-659e1a0c-c35e-4fcb-9775-f3c406d9bd40 req-b65eb00f-a7cb-48a0-b9f6-20831e4246a0 service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-deleted-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-c3050c46-7dea-4050-9201-407250ac4ed6 req-2c5748a8-6da7-478c-bbe5-0ce7d70ac51d service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c3050c46-7dea-4050-9201-407250ac4ed6 req-2c5748a8-6da7-478c-bbe5-0ce7d70ac51d service nova] Acquiring lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c3050c46-7dea-4050-9201-407250ac4ed6 req-2c5748a8-6da7-478c-bbe5-0ce7d70ac51d service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c3050c46-7dea-4050-9201-407250ac4ed6 req-2c5748a8-6da7-478c-bbe5-0ce7d70ac51d service nova] Lock "9f62ede8-a1ed-411a-9720-b187674f974f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-c3050c46-7dea-4050-9201-407250ac4ed6 req-2c5748a8-6da7-478c-bbe5-0ce7d70ac51d service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] No waiting events found dispatching network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:10 user nova-compute[75071]: WARNING nova.compute.manager [req-c3050c46-7dea-4050-9201-407250ac4ed6 req-2c5748a8-6da7-478c-bbe5-0ce7d70ac51d service nova] [instance: 9f62ede8-a1ed-411a-9720-b187674f974f] Received unexpected event network-vif-plugged-8a523b75-f9bb-49e1-bca9-a09400acd9ab for instance with vm_state deleted and task_state None.
Nov 29 13:38:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:10 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Deleted allocations for instance 9f62ede8-a1ed-411a-9720-b187674f974f
Nov 29 13:38:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c97c84e3-4f65-492a-9dfe-340e8939b762 tempest-AttachVolumeShelveTestJSON-2031472443 tempest-AttachVolumeShelveTestJSON-2031472443-project-member] Lock "9f62ede8-a1ed-411a-9720-b187674f974f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance destroyed successfully.
Nov 29 13:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:12 user nova-compute[75071]: WARNING nova.compute.manager [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:12 user nova-compute[75071]: WARNING nova.compute.manager [req-932e2f35-1390-4416-97d3-95bac910830b req-b29cbeb6-530d-4736-a531-e6fe66f0f948 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b51c0e54-386f-4bef-b700-ab10d7565039 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:14 user nova-compute[75071]: WARNING nova.compute.manager [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:38:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:14 user nova-compute[75071]: WARNING nova.compute.manager [req-27b4b136-8b41-4e8b-9ffc-77a29e6c2c62 req-0dfa6c38-67cd-475d-85ea-3fd96a232881 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:38:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:38:39 user nova-compute[75071]: INFO nova.compute.claims [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Claim successful on node user
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:38:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.policy [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80b78150bab7440daf6d7fe0d25d4cf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fead1ec3dc0456eb2dd2290009247a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:38:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Creating image(s)
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "/opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "/opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk 1073741824" returned: 0 in 0.052s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Successfully created port: 79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Cannot resize image /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Ensure instance console log exists: /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Successfully updated port: 79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquired lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-changed-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Refreshing instance network info cache due to event network-changed-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] Acquiring lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updating instance_info_cache with network_info: [{"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Releasing lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Instance network_info: |[{"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] Acquired lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Refreshing network info cache for port 79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Start _get_guest_xml network_info=[{"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:38:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:38:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-43361750',display_name='tempest-AttachVolumeTestJSON-server-43361750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-43361750',id=40,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOw2bwXMtvL5KYzotuKXufhMHXskXj2NTLJB+2WY//vmqmSfXKB34/mruZ6VUmcyicDkPI752aq8/8MPY4a3C3iSZVOhMc2efIL38PXQUqEe7oEOx4NFTB8UIVbHxskdw==',key_name='tempest-keypair-849444990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-r3lf231e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=a2b15e2b-3416-4a1d-971e-e9ffb1de396d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3c:46,bridge_name='br-int',has_traffic_filtering=True,id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb4319-9b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'pci_devices' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:38:42 user nova-compute[75071]:   <uuid>a2b15e2b-3416-4a1d-971e-e9ffb1de396d</uuid>
Nov 29 13:38:42 user nova-compute[75071]:   <name>instance-00000028</name>
Nov 29 13:38:42 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:38:42 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:38:42 user nova-compute[75071]:   <metadata>
Nov 29 13:38:42 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:38:42 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:38:42 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-43361750</nova:name>
Nov 29 13:38:42 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:38:42</nova:creationTime>
Nov 29 13:38:42 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:38:42 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:38:42 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:38:42 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:38:42 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:38:42 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:38:42 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:38:42 user nova-compute[75071]:       <nova:owner>
Nov 29 13:38:42 user nova-compute[75071]:         <nova:user uuid="80b78150bab7440daf6d7fe0d25d4cf2">tempest-AttachVolumeTestJSON-964246432-project-member</nova:user>
Nov 29 13:38:42 user nova-compute[75071]:         <nova:project uuid="9fead1ec3dc0456eb2dd2290009247a9">tempest-AttachVolumeTestJSON-964246432</nova:project>
Nov 29 13:38:42 user nova-compute[75071]:       </nova:owner>
Nov 29 13:38:42 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:38:42 user nova-compute[75071]:       <nova:ports>
Nov 29 13:38:42 user nova-compute[75071]:         <nova:port uuid="79cb4319-9bf2-44a6-a4ad-2becc5eb64ae">
Nov 29 13:38:42 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:38:42 user nova-compute[75071]:         </nova:port>
Nov 29 13:38:42 user nova-compute[75071]:       </nova:ports>
Nov 29 13:38:42 user nova-compute[75071]:     </nova:instance>
Nov 29 13:38:42 user nova-compute[75071]:   </metadata>
Nov 29 13:38:42 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:38:42 user nova-compute[75071]:     <system>
Nov 29 13:38:42 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:38:42 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:38:42 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:38:42 user nova-compute[75071]:       <entry name="serial">a2b15e2b-3416-4a1d-971e-e9ffb1de396d</entry>
Nov 29 13:38:42 user nova-compute[75071]:       <entry name="uuid">a2b15e2b-3416-4a1d-971e-e9ffb1de396d</entry>
Nov 29 13:38:42 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:38:42 user nova-compute[75071]:     </system>
Nov 29 13:38:42 user nova-compute[75071]:   </sysinfo>
Nov 29 13:38:42 user nova-compute[75071]:   <os>
Nov 29 13:38:42 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:38:42 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:38:42 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:38:42 user nova-compute[75071]:   </os>
Nov 29 13:38:42 user nova-compute[75071]:   <features>
Nov 29 13:38:42 user nova-compute[75071]:     <acpi/>
Nov 29 13:38:42 user nova-compute[75071]:     <apic/>
Nov 29 13:38:42 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:38:42 user nova-compute[75071]:   </features>
Nov 29 13:38:42 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:38:42 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:38:42 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:38:42 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:38:42 user nova-compute[75071]:   </clock>
Nov 29 13:38:42 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:38:42 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:38:42 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:38:42 user nova-compute[75071]:   </cpu>
Nov 29 13:38:42 user nova-compute[75071]:   <devices>
Nov 29 13:38:42 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:38:42 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:38:42 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk"/>
Nov 29 13:38:42 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:38:42 user nova-compute[75071]:     </disk>
Nov 29 13:38:42 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:38:42 user nova-compute[75071]:       <mac address="fa:16:3e:dc:3c:46"/>
Nov 29 13:38:42 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:38:42 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:38:42 user nova-compute[75071]:       <target dev="tap79cb4319-9b"/>
Nov 29 13:38:42 user nova-compute[75071]:     </interface>
Nov 29 13:38:42 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:38:42 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/console.log" append="off"/>
Nov 29 13:38:42 user nova-compute[75071]:     </serial>
Nov 29 13:38:42 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:38:42 user nova-compute[75071]:     <video>
Nov 29 13:38:42 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:38:42 user nova-compute[75071]:     </video>
Nov 29 13:38:42 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:38:42 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:38:42 user nova-compute[75071]:     </rng>
Nov 29 13:38:42 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:38:42 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:38:42 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:38:42 user nova-compute[75071]:     </memballoon>
Nov 29 13:38:42 user nova-compute[75071]:   </devices>
Nov 29 13:38:42 user nova-compute[75071]: </domain>
Nov 29 13:38:42 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-43361750',display_name='tempest-AttachVolumeTestJSON-server-43361750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-43361750',id=40,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOw2bwXMtvL5KYzotuKXufhMHXskXj2NTLJB+2WY//vmqmSfXKB34/mruZ6VUmcyicDkPI752aq8/8MPY4a3C3iSZVOhMc2efIL38PXQUqEe7oEOx4NFTB8UIVbHxskdw==',key_name='tempest-keypair-849444990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-r3lf231e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=a2b15e2b-3416-4a1d-971e-e9ffb1de396d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3c:46,bridge_name='br-int',has_traffic_filtering=True,id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb4319-9b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG os_vif [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3c:46,bridge_name='br-int',has_traffic_filtering=True,id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb4319-9b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31fb3774-da28-5c8c-93ef-2e27efcff473', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79cb4319-9b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79cb4319-9b, col_values=(('qos', UUID('e57778aa-483f-485e-8bf0-fcfff7402771')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79cb4319-9b, col_values=(('external_ids', {'iface-id': '79cb4319-9bf2-44a6-a4ad-2becc5eb64ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:3c:46', 'vm-uuid': 'a2b15e2b-3416-4a1d-971e-e9ffb1de396d'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:42 user nova-compute[75071]: INFO os_vif [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:3c:46,bridge_name='br-int',has_traffic_filtering=True,id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb4319-9b')
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No VIF found with MAC fa:16:3e:dc:3c:46, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updated VIF entry in instance network info cache for port 79cb4319-9bf2-44a6-a4ad-2becc5eb64ae. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updating instance_info_cache with network_info: [{"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aa5b1029-6bf6-4335-83be-c75d809cad60 req-5cb62f36-0082-474f-85e7-81495af3537c service nova] Releasing lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-967ec1a2-e830-4c3a-bac4-49b9689e02af req-1d50f9f3-e3be-467a-ba9b-572278aa63ae service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-967ec1a2-e830-4c3a-bac4-49b9689e02af req-1d50f9f3-e3be-467a-ba9b-572278aa63ae service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-967ec1a2-e830-4c3a-bac4-49b9689e02af req-1d50f9f3-e3be-467a-ba9b-572278aa63ae service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-967ec1a2-e830-4c3a-bac4-49b9689e02af req-1d50f9f3-e3be-467a-ba9b-572278aa63ae service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-967ec1a2-e830-4c3a-bac4-49b9689e02af req-1d50f9f3-e3be-467a-ba9b-572278aa63ae service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:43 user nova-compute[75071]: WARNING nova.compute.manager [req-967ec1a2-e830-4c3a-bac4-49b9689e02af req-1d50f9f3-e3be-467a-ba9b-572278aa63ae service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received unexpected event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with vm_state building and task_state spawning.
Nov 29 13:38:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e514643-6ca6-4a5c-b86c-ee887249df1c req-06c3c1bf-9ba3-4d0a-bd13-926fbad091b8 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e514643-6ca6-4a5c-b86c-ee887249df1c req-06c3c1bf-9ba3-4d0a-bd13-926fbad091b8 service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e514643-6ca6-4a5c-b86c-ee887249df1c req-06c3c1bf-9ba3-4d0a-bd13-926fbad091b8 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e514643-6ca6-4a5c-b86c-ee887249df1c req-06c3c1bf-9ba3-4d0a-bd13-926fbad091b8 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e514643-6ca6-4a5c-b86c-ee887249df1c req-06c3c1bf-9ba3-4d0a-bd13-926fbad091b8 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:38:45 user nova-compute[75071]: WARNING nova.compute.manager [req-1e514643-6ca6-4a5c-b86c-ee887249df1c req-06c3c1bf-9ba3-4d0a-bd13-926fbad091b8 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received unexpected event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with vm_state building and task_state spawning.
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:38:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Instance spawned successfully.
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:38:45 user nova-compute[75071]: INFO nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 29 13:38:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:38:45 user nova-compute[75071]: INFO nova.compute.manager [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Took 6.21 seconds to build instance.
Nov 29 13:38:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5c086b74-15cf-43b3-b8d6-7e6441e9c3df tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.304s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:38:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: fcb58221-096b-4275-874f-efb5043b610b] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: fcb58221-096b-4275-874f-efb5043b610b] Updating instance_info_cache with network_info: [{"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-fcb58221-096b-4275-874f-efb5043b610b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: fcb58221-096b-4275-874f-efb5043b610b] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:39:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:39:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:39:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=24.835494995117188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6a2550b8-269a-4cfb-887b-a3f3745812a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 39691897-8629-4f70-a9b0-bdca787876bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b6bdb155-e37b-4b39-b202-a343a870a52f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:39:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.721s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:39:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-changed-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Refreshing instance network info cache due to event network-changed-4573816e-b49e-40c2-a8e4-24cdf8fd0852. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] Acquiring lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] Acquired lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.network.neutron [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Refreshing network info cache for port 4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.network.neutron [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Updated VIF entry in instance network info cache for port 4573816e-b49e-40c2-a8e4-24cdf8fd0852. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.network.neutron [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Updating instance_info_cache with network_info: [{"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e181f3fb-d68a-406b-b6e2-0706d41d8876 req-b9b4fb4b-2fa7-4473-b60c-bb9aa886fd12 service nova] Releasing lock "refresh_cache-39691897-8629-4f70-a9b0-bdca787876bf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "39691897-8629-4f70-a9b0-bdca787876bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "39691897-8629-4f70-a9b0-bdca787876bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "39691897-8629-4f70-a9b0-bdca787876bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:15 user nova-compute[75071]: INFO nova.compute.manager [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Terminating instance
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-48536d6c-50d0-4b7a-9d52-b4667ebe7dba req-ae5109ce-2d63-4161-9490-37936e631b10 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-vif-unplugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-48536d6c-50d0-4b7a-9d52-b4667ebe7dba req-ae5109ce-2d63-4161-9490-37936e631b10 service nova] Acquiring lock "39691897-8629-4f70-a9b0-bdca787876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-48536d6c-50d0-4b7a-9d52-b4667ebe7dba req-ae5109ce-2d63-4161-9490-37936e631b10 service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-48536d6c-50d0-4b7a-9d52-b4667ebe7dba req-ae5109ce-2d63-4161-9490-37936e631b10 service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-48536d6c-50d0-4b7a-9d52-b4667ebe7dba req-ae5109ce-2d63-4161-9490-37936e631b10 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] No waiting events found dispatching network-vif-unplugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-48536d6c-50d0-4b7a-9d52-b4667ebe7dba req-ae5109ce-2d63-4161-9490-37936e631b10 service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-vif-unplugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:39:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Instance destroyed successfully.
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.objects.instance [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'resources' on Instance uuid 39691897-8629-4f70-a9b0-bdca787876bf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1636632971',display_name='tempest-TestVolumeBootPattern-server-1636632971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1636632971',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-6fkp8cou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:37:37Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=39691897-8629-4f70-a9b0-bdca787876bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "address": "fa:16:3e:c7:e7:ca", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4573816e-b4", "ovs_interfaceid": "4573816e-b49e-40c2-a8e4-24cdf8fd0852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e7:ca,bridge_name='br-int',has_traffic_filtering=True,id=4573816e-b49e-40c2-a8e4-24cdf8fd0852,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4573816e-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_vif [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e7:ca,bridge_name='br-int',has_traffic_filtering=True,id=4573816e-b49e-40c2-a8e4-24cdf8fd0852,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4573816e-b4') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4573816e-b4, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f393b91a-645a-4234-b9b3-d03e06ef98db) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:16 user nova-compute[75071]: INFO os_vif [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e7:ca,bridge_name='br-int',has_traffic_filtering=True,id=4573816e-b49e-40c2-a8e4-24cdf8fd0852,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4573816e-b4')
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:39:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[585f3343-bd61-4951-9abb-d8c0522ffe8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:39:16 user nova-compute[75071]: No targets found.
Nov 29 13:39:16 user nova-compute[75071]: iSNS:
Nov 29 13:39:16 user nova-compute[75071]: No targets found.
Nov 29 13:39:16 user nova-compute[75071]: STATIC:
Nov 29 13:39:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb
Nov 29 13:39:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:39:16 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:39:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:39:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:39:16 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:39:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135
Nov 29 13:39:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:39:16 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:39:16 user nova-compute[75071]: FIRMWARE:
Nov 29 13:39:16 user nova-compute[75071]: No targets found.
Nov 29 13:39:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:39:16 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:39:16 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c13d8-d518-4a6d-b78e-d66fe6a10d5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[986a6490-132c-4210-aff9-38937996c0de]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:39:16 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:39:16 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:39:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:39:16 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:39:16 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:39:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e3a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa5481-b319-4406-bf4e-f3c3287ffa52]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e49357-7793-4663-baea-5b3bf76f4801]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f77a4e-f4f1-41a9-82f1-950b324724e1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1aa997-89c7-4ec6-adde-8ba1c14f1272]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b020f91f', '/dev/disk/by-id/scsi-23133643561343231', '/dev/disk/by-id/scsi-1SCST_BIOb020f91f-13d5a4217f312176') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb6832f-323d-4435-80af-fb30963eb49d]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[067fc6c1-2a60-471b-8149-f7770d480674]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[269ec4d5-958b-428f-85b8-ea20ce1174a3]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]
Nov 29 13:39:16 user nova-compute[75071]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.
Nov 29 13:39:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[def3750a-2414-4190-858c-d152fe719a5b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== disconnect_volume: return (307ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:39:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Deleting instance files /opt/stack/data/nova/instances/39691897-8629-4f70-a9b0-bdca787876bf_del
Nov 29 13:39:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Deletion of /opt/stack/data/nova/instances/39691897-8629-4f70-a9b0-bdca787876bf_del complete
Nov 29 13:39:16 user nova-compute[75071]: INFO nova.compute.manager [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 29 13:39:16 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:39:16 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:39:17 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:39:17 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Took 0.70 seconds to deallocate network for instance.
Nov 29 13:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-97b31b39-5bdf-4bff-87b5-5efda3f66e0f req-37a8c430-5f19-4ed4-90c3-d97d0259314c service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-97b31b39-5bdf-4bff-87b5-5efda3f66e0f req-37a8c430-5f19-4ed4-90c3-d97d0259314c service nova] Acquiring lock "39691897-8629-4f70-a9b0-bdca787876bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-97b31b39-5bdf-4bff-87b5-5efda3f66e0f req-37a8c430-5f19-4ed4-90c3-d97d0259314c service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-97b31b39-5bdf-4bff-87b5-5efda3f66e0f req-37a8c430-5f19-4ed4-90c3-d97d0259314c service nova] Lock "39691897-8629-4f70-a9b0-bdca787876bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-97b31b39-5bdf-4bff-87b5-5efda3f66e0f req-37a8c430-5f19-4ed4-90c3-d97d0259314c service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] No waiting events found dispatching network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:18 user nova-compute[75071]: WARNING nova.compute.manager [req-97b31b39-5bdf-4bff-87b5-5efda3f66e0f req-37a8c430-5f19-4ed4-90c3-d97d0259314c service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received unexpected event network-vif-plugged-4573816e-b49e-40c2-a8e4-24cdf8fd0852 for instance with vm_state active and task_state deleting.
Nov 29 13:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-97b31b39-5bdf-4bff-87b5-5efda3f66e0f req-37a8c430-5f19-4ed4-90c3-d97d0259314c service nova] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Received event network-vif-deleted-4573816e-b49e-40c2-a8e4-24cdf8fd0852 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:18 user nova-compute[75071]: INFO nova.compute.manager [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 39691897-8629-4f70-a9b0-bdca787876bf] Took 0.83 seconds to detach 1 volumes for instance.
Nov 29 13:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:18 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Deleted allocations for instance 39691897-8629-4f70-a9b0-bdca787876bf
Nov 29 13:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eac3a0-65f9-43f5-96a0-3c0b109b2448 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "39691897-8629-4f70-a9b0-bdca787876bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.193s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "b6bdb155-e37b-4b39-b202-a343a870a52f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:28 user nova-compute[75071]: INFO nova.compute.manager [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Terminating instance
Nov 29 13:39:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-0dd9c3df-bce4-4006-b57b-bb46b68f6122 req-f917e505-56dc-43c5-b25a-606feb3022a9 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received event network-vif-unplugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0dd9c3df-bce4-4006-b57b-bb46b68f6122 req-f917e505-56dc-43c5-b25a-606feb3022a9 service nova] Acquiring lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0dd9c3df-bce4-4006-b57b-bb46b68f6122 req-f917e505-56dc-43c5-b25a-606feb3022a9 service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0dd9c3df-bce4-4006-b57b-bb46b68f6122 req-f917e505-56dc-43c5-b25a-606feb3022a9 service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-0dd9c3df-bce4-4006-b57b-bb46b68f6122 req-f917e505-56dc-43c5-b25a-606feb3022a9 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] No waiting events found dispatching network-vif-unplugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-0dd9c3df-bce4-4006-b57b-bb46b68f6122 req-f917e505-56dc-43c5-b25a-606feb3022a9 service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received event network-vif-unplugged-865da7f3-f417-4bd6-9a71-95630093dd73 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:39:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Instance destroyed successfully.
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lazy-loading 'resources' on Instance uuid b6bdb155-e37b-4b39-b202-a343a870a52f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-707358433',display_name='tempest-VolumesActionsTest-instance-707358433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-707358433',id=37,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:37:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80aae2c977154745aec9e9463767dbbb',ramdisk_id='',reservation_id='r-d2oakd6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1166636287',owner_user_name='tempest-VolumesActionsTest-1166636287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:37:45Z,user_data=None,user_id='fb5e9e2b5adc49de9355b7a80eb741d7',uuid=b6bdb155-e37b-4b39-b202-a343a870a52f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converting VIF {"id": "865da7f3-f417-4bd6-9a71-95630093dd73", "address": "fa:16:3e:90:2c:fe", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865da7f3-f4", "ovs_interfaceid": "865da7f3-f417-4bd6-9a71-95630093dd73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=865da7f3-f417-4bd6-9a71-95630093dd73,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865da7f3-f4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG os_vif [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=865da7f3-f417-4bd6-9a71-95630093dd73,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865da7f3-f4') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap865da7f3-f4, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1ec7716-a45b-44b0-aea0-db0f56ced927) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:39:29 user nova-compute[75071]: INFO os_vif [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2c:fe,bridge_name='br-int',has_traffic_filtering=True,id=865da7f3-f417-4bd6-9a71-95630093dd73,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865da7f3-f4')
Nov 29 13:39:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Deleting instance files /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f_del
Nov 29 13:39:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Deletion of /opt/stack/data/nova/instances/b6bdb155-e37b-4b39-b202-a343a870a52f_del complete
Nov 29 13:39:29 user nova-compute[75071]: INFO nova.compute.manager [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 13:39:29 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:39:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:39:30 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:39:30 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Took 0.54 seconds to deallocate network for instance.
Nov 29 13:39:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f2a7f1a-7676-4e9c-bca5-389c89155445 req-7d9f91b2-1369-4a3e-99aa-2094b62ec7da service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received event network-vif-deleted-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:30 user nova-compute[75071]: INFO nova.compute.manager [req-0f2a7f1a-7676-4e9c-bca5-389c89155445 req-7d9f91b2-1369-4a3e-99aa-2094b62ec7da service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Neutron deleted interface 865da7f3-f417-4bd6-9a71-95630093dd73; detaching it from the instance and deleting it from the info cache
Nov 29 13:39:30 user nova-compute[75071]: DEBUG nova.network.neutron [req-0f2a7f1a-7676-4e9c-bca5-389c89155445 req-7d9f91b2-1369-4a3e-99aa-2094b62ec7da service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:39:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f2a7f1a-7676-4e9c-bca5-389c89155445 req-7d9f91b2-1369-4a3e-99aa-2094b62ec7da service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Detach interface failed, port_id=865da7f3-f417-4bd6-9a71-95630093dd73, reason: Instance b6bdb155-e37b-4b39-b202-a343a870a52f could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:39:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:30 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:39:30 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:39:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:30 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Deleted allocations for instance b6bdb155-e37b-4b39-b202-a343a870a52f
Nov 29 13:39:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8e1510ab-d295-4123-ad4c-40001332706b tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-f9ad1f08-c473-4e68-9d09-fbf25e669454 req-1761f5ca-b33d-4670-97ed-61ac7f6beffb service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received event network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f9ad1f08-c473-4e68-9d09-fbf25e669454 req-1761f5ca-b33d-4670-97ed-61ac7f6beffb service nova] Acquiring lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f9ad1f08-c473-4e68-9d09-fbf25e669454 req-1761f5ca-b33d-4670-97ed-61ac7f6beffb service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f9ad1f08-c473-4e68-9d09-fbf25e669454 req-1761f5ca-b33d-4670-97ed-61ac7f6beffb service nova] Lock "b6bdb155-e37b-4b39-b202-a343a870a52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-f9ad1f08-c473-4e68-9d09-fbf25e669454 req-1761f5ca-b33d-4670-97ed-61ac7f6beffb service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] No waiting events found dispatching network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:31 user nova-compute[75071]: WARNING nova.compute.manager [req-f9ad1f08-c473-4e68-9d09-fbf25e669454 req-1761f5ca-b33d-4670-97ed-61ac7f6beffb service nova] [instance: b6bdb155-e37b-4b39-b202-a343a870a52f] Received unexpected event network-vif-plugged-865da7f3-f417-4bd6-9a71-95630093dd73 for instance with vm_state deleted and task_state None.
Nov 29 13:39:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:39:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:49 user nova-compute[75071]: INFO nova.compute.manager [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Rescuing
Nov 29 13:39:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:39:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:39:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:39:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-811c9333-f104-477d-a258-a2de55c805f3 req-04ff18ed-36e9-4d4e-adee-5b722d4ad365 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-unplugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-811c9333-f104-477d-a258-a2de55c805f3 req-04ff18ed-36e9-4d4e-adee-5b722d4ad365 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-811c9333-f104-477d-a258-a2de55c805f3 req-04ff18ed-36e9-4d4e-adee-5b722d4ad365 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-811c9333-f104-477d-a258-a2de55c805f3 req-04ff18ed-36e9-4d4e-adee-5b722d4ad365 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-811c9333-f104-477d-a258-a2de55c805f3 req-04ff18ed-36e9-4d4e-adee-5b722d4ad365 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-unplugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:50 user nova-compute[75071]: WARNING nova.compute.manager [req-811c9333-f104-477d-a258-a2de55c805f3 req-04ff18ed-36e9-4d4e-adee-5b722d4ad365 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received unexpected event network-vif-unplugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with vm_state active and task_state rescuing.
Nov 29 13:39:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance destroyed successfully.
Nov 29 13:39:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Attempting rescue
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:39:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Creating image(s)
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.266s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue" returned: 0 in 0.056s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'migration_context' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.base [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<53f642bd-5e9a-4c9d-a866-26eeaf4c465f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Start _get_guest_xml network_info=[{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:6a:be:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '794347ff-8cf3-49d9-8652-9f89337799af', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'resources' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.base [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<53f642bd-5e9a-4c9d-a866-26eeaf4c465f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'numa_topology' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.base [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<53f642bd-5e9a-4c9d-a866-26eeaf4c465f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:39:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:39:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.base [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<53f642bd-5e9a-4c9d-a866-26eeaf4c465f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-956692139',display_name='tempest-ServerRescueNegativeTestJSON-server-956692139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-956692139',id=39,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-82978qtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:07Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=53f642bd-5e9a-4c9d-a866-26eeaf4c465f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:6a:be:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:6a:be:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'pci_devices' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.objects.base [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<53f642bd-5e9a-4c9d-a866-26eeaf4c465f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:39:51 user nova-compute[75071]:   <uuid>53f642bd-5e9a-4c9d-a866-26eeaf4c465f</uuid>
Nov 29 13:39:51 user nova-compute[75071]:   <name>instance-00000027</name>
Nov 29 13:39:51 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:39:51 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:39:51 user nova-compute[75071]:   <metadata>
Nov 29 13:39:51 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:39:51 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:39:51 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-956692139</nova:name>
Nov 29 13:39:51 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:39:51</nova:creationTime>
Nov 29 13:39:51 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:39:51 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:39:51 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:39:51 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:39:51 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:39:51 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:39:51 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:39:51 user nova-compute[75071]:       <nova:owner>
Nov 29 13:39:51 user nova-compute[75071]:         <nova:user uuid="2457f7d6a4f64d2d94a542d73403814f">tempest-ServerRescueNegativeTestJSON-904604817-project-member</nova:user>
Nov 29 13:39:51 user nova-compute[75071]:         <nova:project uuid="02fdf8ccfd7b4320b9422fd1145705cb">tempest-ServerRescueNegativeTestJSON-904604817</nova:project>
Nov 29 13:39:51 user nova-compute[75071]:       </nova:owner>
Nov 29 13:39:51 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:39:51 user nova-compute[75071]:       <nova:ports>
Nov 29 13:39:51 user nova-compute[75071]:         <nova:port uuid="a37a280d-e37b-419f-9a2f-42c32508a1c0">
Nov 29 13:39:51 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 13:39:51 user nova-compute[75071]:         </nova:port>
Nov 29 13:39:51 user nova-compute[75071]:       </nova:ports>
Nov 29 13:39:51 user nova-compute[75071]:     </nova:instance>
Nov 29 13:39:51 user nova-compute[75071]:   </metadata>
Nov 29 13:39:51 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:39:51 user nova-compute[75071]:     <system>
Nov 29 13:39:51 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:39:51 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:39:51 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:39:51 user nova-compute[75071]:       <entry name="serial">53f642bd-5e9a-4c9d-a866-26eeaf4c465f</entry>
Nov 29 13:39:51 user nova-compute[75071]:       <entry name="uuid">53f642bd-5e9a-4c9d-a866-26eeaf4c465f</entry>
Nov 29 13:39:51 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:39:51 user nova-compute[75071]:     </system>
Nov 29 13:39:51 user nova-compute[75071]:   </sysinfo>
Nov 29 13:39:51 user nova-compute[75071]:   <os>
Nov 29 13:39:51 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:39:51 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:39:51 user nova-compute[75071]:   </os>
Nov 29 13:39:51 user nova-compute[75071]:   <features>
Nov 29 13:39:51 user nova-compute[75071]:     <acpi/>
Nov 29 13:39:51 user nova-compute[75071]:     <apic/>
Nov 29 13:39:51 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:39:51 user nova-compute[75071]:   </features>
Nov 29 13:39:51 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:39:51 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:39:51 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:39:51 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:39:51 user nova-compute[75071]:   </clock>
Nov 29 13:39:51 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:39:51 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:39:51 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:39:51 user nova-compute[75071]:   </cpu>
Nov 29 13:39:51 user nova-compute[75071]:   <devices>
Nov 29 13:39:51 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:39:51 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:39:51 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue"/>
Nov 29 13:39:51 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:39:51 user nova-compute[75071]:     </disk>
Nov 29 13:39:51 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:39:51 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:39:51 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk"/>
Nov 29 13:39:51 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:39:51 user nova-compute[75071]:     </disk>
Nov 29 13:39:51 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:39:51 user nova-compute[75071]:       <mac address="fa:16:3e:6a:be:95"/>
Nov 29 13:39:51 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:39:51 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:39:51 user nova-compute[75071]:       <target dev="tapa37a280d-e3"/>
Nov 29 13:39:51 user nova-compute[75071]:     </interface>
Nov 29 13:39:51 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:39:51 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/console.log" append="off"/>
Nov 29 13:39:51 user nova-compute[75071]:     </serial>
Nov 29 13:39:51 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:39:51 user nova-compute[75071]:     <video>
Nov 29 13:39:51 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:39:51 user nova-compute[75071]:     </video>
Nov 29 13:39:51 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:39:51 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:39:51 user nova-compute[75071]:     </rng>
Nov 29 13:39:51 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:39:51 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:39:51 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:39:51 user nova-compute[75071]:     </memballoon>
Nov 29 13:39:51 user nova-compute[75071]:   </devices>
Nov 29 13:39:51 user nova-compute[75071]: </domain>
Nov 29 13:39:51 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:39:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance destroyed successfully.
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No VIF found with MAC fa:16:3e:6a:be:95, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:39:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-c8e512ee-e75f-483d-a6f6-5d63b4571317 req-97c79c1b-97be-4e63-b649-6e507c5d7416 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8e512ee-e75f-483d-a6f6-5d63b4571317 req-97c79c1b-97be-4e63-b649-6e507c5d7416 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8e512ee-e75f-483d-a6f6-5d63b4571317 req-97c79c1b-97be-4e63-b649-6e507c5d7416 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8e512ee-e75f-483d-a6f6-5d63b4571317 req-97c79c1b-97be-4e63-b649-6e507c5d7416 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-c8e512ee-e75f-483d-a6f6-5d63b4571317 req-97c79c1b-97be-4e63-b649-6e507c5d7416 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:52 user nova-compute[75071]: WARNING nova.compute.manager [req-c8e512ee-e75f-483d-a6f6-5d63b4571317 req-97c79c1b-97be-4e63-b649-6e507c5d7416 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received unexpected event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with vm_state active and task_state rescuing.
Nov 29 13:39:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:54 user nova-compute[75071]: WARNING nova.compute.manager [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received unexpected event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with vm_state active and task_state rescuing.
Nov 29 13:39:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:39:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:39:54 user nova-compute[75071]: WARNING nova.compute.manager [req-bc83ed05-9c23-44a8-8bab-74d1cfb71090 req-fac5f8ae-2f6b-4b61-8346-82ba40701c87 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received unexpected event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with vm_state active and task_state rescuing.
Nov 29 13:39:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7d5ae6c6-75a9-43bf-a7de-5ccd5ae1baa2 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:39:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:39:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:39:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:39:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:39:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:39:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updating instance_info_cache with network_info: [{"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:39:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-6a2550b8-269a-4cfb-887b-a3f3745812a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:39:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:39:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:39:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:00 user nova-compute[75071]: INFO nova.compute.manager [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Terminating instance
Nov 29 13:40:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e2e230b-0a14-44c0-88f8-5c3e12fab993 req-772c2eb3-b9d5-4607-b56b-1a716786a624 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e2e230b-0a14-44c0-88f8-5c3e12fab993 req-772c2eb3-b9d5-4607-b56b-1a716786a624 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e2e230b-0a14-44c0-88f8-5c3e12fab993 req-772c2eb3-b9d5-4607-b56b-1a716786a624 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e2e230b-0a14-44c0-88f8-5c3e12fab993 req-772c2eb3-b9d5-4607-b56b-1a716786a624 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e2e230b-0a14-44c0-88f8-5c3e12fab993 req-772c2eb3-b9d5-4607-b56b-1a716786a624 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e2e230b-0a14-44c0-88f8-5c3e12fab993 req-772c2eb3-b9d5-4607-b56b-1a716786a624 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-unplugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Instance destroyed successfully.
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'resources' on Instance uuid 6a2550b8-269a-4cfb-887b-a3f3745812a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-836993308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-836993308',id=35,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:36:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-hnur9bum',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:38:15Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=6a2550b8-269a-4cfb-887b-a3f3745812a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "8a52ed97-212a-42ce-9462-843bda80dfa0", "address": "fa:16:3e:4d:19:86", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a52ed97-21", "ovs_interfaceid": "8a52ed97-212a-42ce-9462-843bda80dfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_vif [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a52ed97-21, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37eda0c3-d5e2-4353-bee1-c0661c100100) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:01 user nova-compute[75071]: INFO os_vif [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:19:86,bridge_name='br-int',has_traffic_filtering=True,id=8a52ed97-212a-42ce-9462-843bda80dfa0,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a52ed97-21')
Nov 29 13:40:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAHiDyof', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:40:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[250de3a7-0942-469d-8460-d429210a95cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:40:01 user nova-compute[75071]: No targets found.
Nov 29 13:40:01 user nova-compute[75071]: iSNS:
Nov 29 13:40:01 user nova-compute[75071]: No targets found.
Nov 29 13:40:01 user nova-compute[75071]: STATIC:
Nov 29 13:40:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb
Nov 29 13:40:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:40:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:40:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:40:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:40:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:40:01 user nova-compute[75071]: FIRMWARE:
Nov 29 13:40:01 user nova-compute[75071]: No targets found.
Nov 29 13:40:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:40:01 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:40:01 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aaa2c5-e2ee-42ba-bd55-d2842c73c369]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b6ffe4-52ba-4eb0-ba0b-cedadfe347aa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:01 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:40:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:01 user nova-compute[75071]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb (non-flash)
Nov 29 13:40:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f216c5f7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[272cceba-991b-4676-8bae-3d9993f87601]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecbc4c1-6a47-4a6d-b5d2-1925a29d942b]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03c0c8f-1b4e-4c73-a59f-62ff827634c6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[737018f0-106d-4ea0-91b1-ebe72396bc5f]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8ffd359a-bf9d6bcf89e9e19d', '/dev/disk/by-id/scsi-26266396436626366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8ffd359a') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab51667d-3cc2-4443-bae3-7416722dff36]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fbed91-be09-4620-b328-2f92fa2e4a99]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b0bb30-35f3-444a-acf8-0ab23b9dd30a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260]
Nov 29 13:40:02 user nova-compute[75071]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb, portal: 172.16.0.220,3260] successful.
Nov 29 13:40:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f230d135-cd25-43ac-a400-03ebd6fd03fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b807175-10a4-43eb-9691-87efdfe69b07]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== disconnect_volume: return (394ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:40:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Deleting instance files /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1_del
Nov 29 13:40:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Deletion of /opt/stack/data/nova/instances/6a2550b8-269a-4cfb-887b-a3f3745812a1_del complete
Nov 29 13:40:02 user nova-compute[75071]: INFO nova.compute.manager [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:40:02 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:40:02 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Took 0.43 seconds to deallocate network for instance.
Nov 29 13:40:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:40:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=24.824066162109375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance fcb58221-096b-4275-874f-efb5043b610b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 6a2550b8-269a-4cfb-887b-a3f3745812a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba1ea1c5-f0de-44f7-82a6-6894b6c9c3d9 req-81a1bd68-a373-41f8-8650-fc27c3e09bc6 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba1ea1c5-f0de-44f7-82a6-6894b6c9c3d9 req-81a1bd68-a373-41f8-8650-fc27c3e09bc6 service nova] Acquiring lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba1ea1c5-f0de-44f7-82a6-6894b6c9c3d9 req-81a1bd68-a373-41f8-8650-fc27c3e09bc6 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba1ea1c5-f0de-44f7-82a6-6894b6c9c3d9 req-81a1bd68-a373-41f8-8650-fc27c3e09bc6 service nova] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba1ea1c5-f0de-44f7-82a6-6894b6c9c3d9 req-81a1bd68-a373-41f8-8650-fc27c3e09bc6 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] No waiting events found dispatching network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:03 user nova-compute[75071]: WARNING nova.compute.manager [req-ba1ea1c5-f0de-44f7-82a6-6894b6c9c3d9 req-81a1bd68-a373-41f8-8650-fc27c3e09bc6 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received unexpected event network-vif-plugged-8a52ed97-212a-42ce-9462-843bda80dfa0 for instance with vm_state active and task_state deleting.
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba1ea1c5-f0de-44f7-82a6-6894b6c9c3d9 req-81a1bd68-a373-41f8-8650-fc27c3e09bc6 service nova] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Received event network-vif-deleted-8a52ed97-212a-42ce-9462-843bda80dfa0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:03 user nova-compute[75071]: INFO nova.compute.manager [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 6a2550b8-269a-4cfb-887b-a3f3745812a1] Took 0.91 seconds to detach 1 volumes for instance.
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:03 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Deleted allocations for instance 6a2550b8-269a-4cfb-887b-a3f3745812a1
Nov 29 13:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42607be3-e983-470b-b095-25277dbe4de5 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "6a2550b8-269a-4cfb-887b-a3f3745812a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.166s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:40:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:07 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:40:07 user nova-compute[75071]: INFO nova.compute.claims [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Claim successful on node user
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:40:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.policy [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32b037a2bbef4090a2317bfeedd8e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b75ecae6764ce1801dbab6253ac6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:40:08 user nova-compute[75071]: INFO nova.virt.block_device [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Booting with volume 6c1e9956-7eeb-49b0-9cbd-9382e03fb135 at /dev/vda
Nov 29 13:40:08 user nova-compute[75071]: DEBUG os_brick.utils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88b530-3739-46bb-bb70-38684154cd24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa1d5f0-6fce-4b0d-ae26-19f6361fc518]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c2997-2bfa-41ea-be49-fdfabab65ae0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41c95c8-b776-44fd-ac5c-81a7bb12492e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:40:08 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:40:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf88c57e-3dfb-40a9-aee1-e3f2c7da5141]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG os_brick.utils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:40:08 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating existing volume attachment record: 911d09fb-07e5-446a-bbf1-fbcb39d857c1 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Successfully created port: acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Successfully updated port: acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquired lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-changed-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Refreshing instance network info cache due to event network-changed-acf66a52-04f9-4e47-8fa0-b4785a8227e3. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] Acquiring lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:40:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating instance_info_cache with network_info: [{"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Releasing lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Instance network_info: |[{"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] Acquired lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Refreshing network info cache for port acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updated VIF entry in instance network info cache for port acf66a52-04f9-4e47-8fa0-b4785a8227e3. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating instance_info_cache with network_info: [{"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:40:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-01ab6a3c-2b38-4c88-87f7-d32db84da0fe req-b1afaabc-5962-4af3-aeb5-c2e920b4cc59 service nova] Releasing lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:40:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:40:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Creating image(s)
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Ensure instance console log exists: /opt/stack/data/nova/instances/e3bb613a-1a1f-423c-8ad3-8eecf66a7de9/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Start _get_guest_xml network_info=[{"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3bb613a-1a1f-423c-8ad3-8eecf66a7de9', 'attached_at': '', 'detached_at': '', 'volume_id': '6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'serial': '6c1e9956-7eeb-49b0-9cbd-9382e03fb135'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '911d09fb-07e5-446a-bbf1-fbcb39d857c1', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:40:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:40:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:40:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:40:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:40:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:40:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:40:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:40:15 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:40:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260" returned: 21 in 0.131s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3699727-5990-49ee-a3a1-b3691f1359c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:40:16 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6927e8fe-257b-4446-a642-2656b1cea543]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135] added
Nov 29 13:40:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d31d8-1aab-4b9f-b660-b25fa9712855]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c72f68e-f51a-4dbd-b93f-4c2ceae50d97]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGWFsolM {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGWFsolM" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a5cf9-10d4-42f6-abd5-749018e1165e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGWFsolM'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf523d1-3dbe-4fdb-aafb-3d12d98ecf18]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ed804-9440-47d6-9e7b-92cb0c0bc556]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0a3d23-ed93-45fb-b4a8-c2d5868968b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]
Nov 29 13:40:16 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.
Nov 29 13:40:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46712b03-6793-4b8c-8be1-6a48d7a04c08]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6605d69c-e5f9-4abb-a4fb-585ef121c456]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:16 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:16 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac830f87-021b-45a5-ba3d-8ddbcc551db6]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:40:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23133643561343231', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133643561343231', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1742238052',display_name='tempest-TestVolumeBootPattern-server-1742238052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1742238052',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-t0mjkf1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:40:08Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=e3bb613a-1a1f-423c-8ad3-8eecf66a7de9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=acf66a52-04f9-4e47-8fa0-b4785a8227e3,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf66a52-04') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'pci_devices' on Instance uuid e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:40:17 user nova-compute[75071]:   <uuid>e3bb613a-1a1f-423c-8ad3-8eecf66a7de9</uuid>
Nov 29 13:40:17 user nova-compute[75071]:   <name>instance-00000029</name>
Nov 29 13:40:17 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:40:17 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:40:17 user nova-compute[75071]:   <metadata>
Nov 29 13:40:17 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:40:17 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:40:17 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-1742238052</nova:name>
Nov 29 13:40:17 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:40:15</nova:creationTime>
Nov 29 13:40:17 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:40:17 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:40:17 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:40:17 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:40:17 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:40:17 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:40:17 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:40:17 user nova-compute[75071]:       <nova:owner>
Nov 29 13:40:17 user nova-compute[75071]:         <nova:user uuid="32b037a2bbef4090a2317bfeedd8e155">tempest-TestVolumeBootPattern-2055293783-project-member</nova:user>
Nov 29 13:40:17 user nova-compute[75071]:         <nova:project uuid="86b75ecae6764ce1801dbab6253ac6c4">tempest-TestVolumeBootPattern-2055293783</nova:project>
Nov 29 13:40:17 user nova-compute[75071]:       </nova:owner>
Nov 29 13:40:17 user nova-compute[75071]:       <nova:ports>
Nov 29 13:40:17 user nova-compute[75071]:         <nova:port uuid="acf66a52-04f9-4e47-8fa0-b4785a8227e3">
Nov 29 13:40:17 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 13:40:17 user nova-compute[75071]:         </nova:port>
Nov 29 13:40:17 user nova-compute[75071]:       </nova:ports>
Nov 29 13:40:17 user nova-compute[75071]:     </nova:instance>
Nov 29 13:40:17 user nova-compute[75071]:   </metadata>
Nov 29 13:40:17 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:40:17 user nova-compute[75071]:     <system>
Nov 29 13:40:17 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:40:17 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:40:17 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:40:17 user nova-compute[75071]:       <entry name="serial">e3bb613a-1a1f-423c-8ad3-8eecf66a7de9</entry>
Nov 29 13:40:17 user nova-compute[75071]:       <entry name="uuid">e3bb613a-1a1f-423c-8ad3-8eecf66a7de9</entry>
Nov 29 13:40:17 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:40:17 user nova-compute[75071]:     </system>
Nov 29 13:40:17 user nova-compute[75071]:   </sysinfo>
Nov 29 13:40:17 user nova-compute[75071]:   <os>
Nov 29 13:40:17 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:40:17 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:40:17 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:40:17 user nova-compute[75071]:   </os>
Nov 29 13:40:17 user nova-compute[75071]:   <features>
Nov 29 13:40:17 user nova-compute[75071]:     <acpi/>
Nov 29 13:40:17 user nova-compute[75071]:     <apic/>
Nov 29 13:40:17 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:40:17 user nova-compute[75071]:   </features>
Nov 29 13:40:17 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:40:17 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:40:17 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:40:17 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:40:17 user nova-compute[75071]:   </clock>
Nov 29 13:40:17 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:40:17 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:40:17 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:40:17 user nova-compute[75071]:   </cpu>
Nov 29 13:40:17 user nova-compute[75071]:   <devices>
Nov 29 13:40:17 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:40:17 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:40:17 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Nov 29 13:40:17 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:40:17 user nova-compute[75071]:       <serial>6c1e9956-7eeb-49b0-9cbd-9382e03fb135</serial>
Nov 29 13:40:17 user nova-compute[75071]:     </disk>
Nov 29 13:40:17 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:40:17 user nova-compute[75071]:       <mac address="fa:16:3e:b9:d2:9d"/>
Nov 29 13:40:17 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:40:17 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:40:17 user nova-compute[75071]:       <target dev="tapacf66a52-04"/>
Nov 29 13:40:17 user nova-compute[75071]:     </interface>
Nov 29 13:40:17 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:40:17 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/e3bb613a-1a1f-423c-8ad3-8eecf66a7de9/console.log" append="off"/>
Nov 29 13:40:17 user nova-compute[75071]:     </serial>
Nov 29 13:40:17 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:40:17 user nova-compute[75071]:     <video>
Nov 29 13:40:17 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:40:17 user nova-compute[75071]:     </video>
Nov 29 13:40:17 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:40:17 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:40:17 user nova-compute[75071]:     </rng>
Nov 29 13:40:17 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:40:17 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:40:17 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:40:17 user nova-compute[75071]:     </memballoon>
Nov 29 13:40:17 user nova-compute[75071]:   </devices>
Nov 29 13:40:17 user nova-compute[75071]: </domain>
Nov 29 13:40:17 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1742238052',display_name='tempest-TestVolumeBootPattern-server-1742238052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1742238052',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-t0mjkf1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:40:08Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=e3bb613a-1a1f-423c-8ad3-8eecf66a7de9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=acf66a52-04f9-4e47-8fa0-b4785a8227e3,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf66a52-04') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG os_vif [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=acf66a52-04f9-4e47-8fa0-b4785a8227e3,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf66a52-04') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2ec0cab-e5ca-5315-bcd3-1deec39fc3c1', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacf66a52-04, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacf66a52-04, col_values=(('qos', UUID('a9807adf-9c80-48d8-b2d1-b58337ee7f7c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacf66a52-04, col_values=(('external_ids', {'iface-id': 'acf66a52-04f9-4e47-8fa0-b4785a8227e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:d2:9d', 'vm-uuid': 'e3bb613a-1a1f-423c-8ad3-8eecf66a7de9'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:17 user nova-compute[75071]: INFO os_vif [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=acf66a52-04f9-4e47-8fa0-b4785a8227e3,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf66a52-04')
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:40:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No VIF found with MAC fa:16:3e:b9:d2:9d, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:40:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-48d0b8d8-90ae-406f-9337-ac192725b076 req-bae38f45-81a5-42d4-99c1-ecd72e0d8d57 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-48d0b8d8-90ae-406f-9337-ac192725b076 req-bae38f45-81a5-42d4-99c1-ecd72e0d8d57 service nova] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-48d0b8d8-90ae-406f-9337-ac192725b076 req-bae38f45-81a5-42d4-99c1-ecd72e0d8d57 service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-48d0b8d8-90ae-406f-9337-ac192725b076 req-bae38f45-81a5-42d4-99c1-ecd72e0d8d57 service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-48d0b8d8-90ae-406f-9337-ac192725b076 req-bae38f45-81a5-42d4-99c1-ecd72e0d8d57 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] No waiting events found dispatching network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:19 user nova-compute[75071]: WARNING nova.compute.manager [req-48d0b8d8-90ae-406f-9337-ac192725b076 req-bae38f45-81a5-42d4-99c1-ecd72e0d8d57 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received unexpected event network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 for instance with vm_state building and task_state spawning.
Nov 29 13:40:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "bd444771-6b7d-4297-bfbe-86efe908b8fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:40:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:20 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:40:20 user nova-compute[75071]: INFO nova.compute.claims [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Claim successful on node user
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:40:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Instance spawned successfully.
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-60b48abb-cfeb-4124-907c-a98df55676c6 req-b1754448-a583-4e59-a5c3-a2c3253b955c service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-60b48abb-cfeb-4124-907c-a98df55676c6 req-b1754448-a583-4e59-a5c3-a2c3253b955c service nova] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-60b48abb-cfeb-4124-907c-a98df55676c6 req-b1754448-a583-4e59-a5c3-a2c3253b955c service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-60b48abb-cfeb-4124-907c-a98df55676c6 req-b1754448-a583-4e59-a5c3-a2c3253b955c service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-60b48abb-cfeb-4124-907c-a98df55676c6 req-b1754448-a583-4e59-a5c3-a2c3253b955c service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] No waiting events found dispatching network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:21 user nova-compute[75071]: WARNING nova.compute.manager [req-60b48abb-cfeb-4124-907c-a98df55676c6 req-b1754448-a583-4e59-a5c3-a2c3253b955c service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received unexpected event network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 for instance with vm_state building and task_state spawning.
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:40:21 user nova-compute[75071]: INFO nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:40:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.policy [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb5e9e2b5adc49de9355b7a80eb741d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80aae2c977154745aec9e9463767dbbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:40:21 user nova-compute[75071]: INFO nova.compute.manager [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Took 13.71 seconds to build instance.
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:40:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Creating image(s)
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "/opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "/opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6ec-ad78-4c10-b66a-41696f38a3b6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.866s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk 1073741824" returned: 0 in 0.085s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Successfully created port: ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Cannot resize image /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Ensure instance console log exists: /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Successfully updated port: ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "refresh_cache-bd444771-6b7d-4297-bfbe-86efe908b8fc" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquired lock "refresh_cache-bd444771-6b7d-4297-bfbe-86efe908b8fc" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received event network-changed-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Refreshing instance network info cache due to event network-changed-ad349d99-7b05-4681-a3bc-698826a3996a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] Acquiring lock "refresh_cache-bd444771-6b7d-4297-bfbe-86efe908b8fc" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:40:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Updating instance_info_cache with network_info: [{"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Releasing lock "refresh_cache-bd444771-6b7d-4297-bfbe-86efe908b8fc" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Instance network_info: |[{"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] Acquired lock "refresh_cache-bd444771-6b7d-4297-bfbe-86efe908b8fc" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Refreshing network info cache for port ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Start _get_guest_xml network_info=[{"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:40:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:40:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-717774254',display_name='tempest-VolumesActionsTest-instance-717774254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-717774254',id=42,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80aae2c977154745aec9e9463767dbbb',ramdisk_id='',reservation_id='r-3t5lc6ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1166636287',owner_user_name='tempest-VolumesActionsTest-1166636287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:40:21Z,user_data=None,user_id='fb5e9e2b5adc49de9355b7a80eb741d7',uuid=bd444771-6b7d-4297-bfbe-86efe908b8fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converting VIF {"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:50:c0,bridge_name='br-int',has_traffic_filtering=True,id=ad349d99-7b05-4681-a3bc-698826a3996a,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad349d99-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lazy-loading 'pci_devices' on Instance uuid bd444771-6b7d-4297-bfbe-86efe908b8fc {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:40:23 user nova-compute[75071]:   <uuid>bd444771-6b7d-4297-bfbe-86efe908b8fc</uuid>
Nov 29 13:40:23 user nova-compute[75071]:   <name>instance-0000002a</name>
Nov 29 13:40:23 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:40:23 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:40:23 user nova-compute[75071]:   <metadata>
Nov 29 13:40:23 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:40:23 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:40:23 user nova-compute[75071]:       <nova:name>tempest-VolumesActionsTest-instance-717774254</nova:name>
Nov 29 13:40:23 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:40:23</nova:creationTime>
Nov 29 13:40:23 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:40:23 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:40:23 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:40:23 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:40:23 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:40:23 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:40:23 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:40:23 user nova-compute[75071]:       <nova:owner>
Nov 29 13:40:23 user nova-compute[75071]:         <nova:user uuid="fb5e9e2b5adc49de9355b7a80eb741d7">tempest-VolumesActionsTest-1166636287-project-member</nova:user>
Nov 29 13:40:23 user nova-compute[75071]:         <nova:project uuid="80aae2c977154745aec9e9463767dbbb">tempest-VolumesActionsTest-1166636287</nova:project>
Nov 29 13:40:23 user nova-compute[75071]:       </nova:owner>
Nov 29 13:40:23 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:40:23 user nova-compute[75071]:       <nova:ports>
Nov 29 13:40:23 user nova-compute[75071]:         <nova:port uuid="ad349d99-7b05-4681-a3bc-698826a3996a">
Nov 29 13:40:23 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 13:40:23 user nova-compute[75071]:         </nova:port>
Nov 29 13:40:23 user nova-compute[75071]:       </nova:ports>
Nov 29 13:40:23 user nova-compute[75071]:     </nova:instance>
Nov 29 13:40:23 user nova-compute[75071]:   </metadata>
Nov 29 13:40:23 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:40:23 user nova-compute[75071]:     <system>
Nov 29 13:40:23 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:40:23 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:40:23 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:40:23 user nova-compute[75071]:       <entry name="serial">bd444771-6b7d-4297-bfbe-86efe908b8fc</entry>
Nov 29 13:40:23 user nova-compute[75071]:       <entry name="uuid">bd444771-6b7d-4297-bfbe-86efe908b8fc</entry>
Nov 29 13:40:23 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:40:23 user nova-compute[75071]:     </system>
Nov 29 13:40:23 user nova-compute[75071]:   </sysinfo>
Nov 29 13:40:23 user nova-compute[75071]:   <os>
Nov 29 13:40:23 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:40:23 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:40:23 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:40:23 user nova-compute[75071]:   </os>
Nov 29 13:40:23 user nova-compute[75071]:   <features>
Nov 29 13:40:23 user nova-compute[75071]:     <acpi/>
Nov 29 13:40:23 user nova-compute[75071]:     <apic/>
Nov 29 13:40:23 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:40:23 user nova-compute[75071]:   </features>
Nov 29 13:40:23 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:40:23 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:40:23 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:40:23 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:40:23 user nova-compute[75071]:   </clock>
Nov 29 13:40:23 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:40:23 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:40:23 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:40:23 user nova-compute[75071]:   </cpu>
Nov 29 13:40:23 user nova-compute[75071]:   <devices>
Nov 29 13:40:23 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:40:23 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:40:23 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk"/>
Nov 29 13:40:23 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:40:23 user nova-compute[75071]:     </disk>
Nov 29 13:40:23 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:40:23 user nova-compute[75071]:       <mac address="fa:16:3e:43:50:c0"/>
Nov 29 13:40:23 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:40:23 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:40:23 user nova-compute[75071]:       <target dev="tapad349d99-7b"/>
Nov 29 13:40:23 user nova-compute[75071]:     </interface>
Nov 29 13:40:23 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:40:23 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/console.log" append="off"/>
Nov 29 13:40:23 user nova-compute[75071]:     </serial>
Nov 29 13:40:23 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:40:23 user nova-compute[75071]:     <video>
Nov 29 13:40:23 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:40:23 user nova-compute[75071]:     </video>
Nov 29 13:40:23 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:40:23 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:40:23 user nova-compute[75071]:     </rng>
Nov 29 13:40:23 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:40:23 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:40:23 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:40:23 user nova-compute[75071]:     </memballoon>
Nov 29 13:40:23 user nova-compute[75071]:   </devices>
Nov 29 13:40:23 user nova-compute[75071]: </domain>
Nov 29 13:40:23 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-717774254',display_name='tempest-VolumesActionsTest-instance-717774254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-717774254',id=42,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80aae2c977154745aec9e9463767dbbb',ramdisk_id='',reservation_id='r-3t5lc6ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1166636287',owner_user_name='tempest-VolumesActionsTest-1166636287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:40:21Z,user_data=None,user_id='fb5e9e2b5adc49de9355b7a80eb741d7',uuid=bd444771-6b7d-4297-bfbe-86efe908b8fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converting VIF {"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:50:c0,bridge_name='br-int',has_traffic_filtering=True,id=ad349d99-7b05-4681-a3bc-698826a3996a,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad349d99-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG os_vif [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:50:c0,bridge_name='br-int',has_traffic_filtering=True,id=ad349d99-7b05-4681-a3bc-698826a3996a,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad349d99-7b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81c9e0e3-8ad5-5d0e-b77e-b69b8481e91e', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad349d99-7b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad349d99-7b, col_values=(('qos', UUID('ada4a92e-9c46-4efe-8880-be5ac77734de')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad349d99-7b, col_values=(('external_ids', {'iface-id': 'ad349d99-7b05-4681-a3bc-698826a3996a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:50:c0', 'vm-uuid': 'bd444771-6b7d-4297-bfbe-86efe908b8fc'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:23 user nova-compute[75071]: INFO os_vif [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:50:c0,bridge_name='br-int',has_traffic_filtering=True,id=ad349d99-7b05-4681-a3bc-698826a3996a,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad349d99-7b')
Nov 29 13:40:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:40:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] No VIF found with MAC fa:16:3e:43:50:c0, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:40:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Updated VIF entry in instance network info cache for port ad349d99-7b05-4681-a3bc-698826a3996a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:40:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Updating instance_info_cache with network_info: [{"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:40:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-20dbc43b-1963-43ce-921d-68b99c527e91 req-5289b489-8225-4e06-a7be-af2234c6f2ce service nova] Releasing lock "refresh_cache-bd444771-6b7d-4297-bfbe-86efe908b8fc" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-4be584b2-fe44-42d6-83eb-ef46a46f715d req-3419dae9-403c-4452-b7c6-771fa7512d3a service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received event network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4be584b2-fe44-42d6-83eb-ef46a46f715d req-3419dae9-403c-4452-b7c6-771fa7512d3a service nova] Acquiring lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4be584b2-fe44-42d6-83eb-ef46a46f715d req-3419dae9-403c-4452-b7c6-771fa7512d3a service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4be584b2-fe44-42d6-83eb-ef46a46f715d req-3419dae9-403c-4452-b7c6-771fa7512d3a service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-4be584b2-fe44-42d6-83eb-ef46a46f715d req-3419dae9-403c-4452-b7c6-771fa7512d3a service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] No waiting events found dispatching network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:25 user nova-compute[75071]: WARNING nova.compute.manager [req-4be584b2-fe44-42d6-83eb-ef46a46f715d req-3419dae9-403c-4452-b7c6-771fa7512d3a service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received unexpected event network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a for instance with vm_state building and task_state spawning.
Nov 29 13:40:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:40:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Instance spawned successfully.
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-e78ff296-3c80-4587-b0c3-9a9f4aa4614d req-919fdb0c-6716-4869-8320-0659978bcdc6 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received event network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e78ff296-3c80-4587-b0c3-9a9f4aa4614d req-919fdb0c-6716-4869-8320-0659978bcdc6 service nova] Acquiring lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e78ff296-3c80-4587-b0c3-9a9f4aa4614d req-919fdb0c-6716-4869-8320-0659978bcdc6 service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e78ff296-3c80-4587-b0c3-9a9f4aa4614d req-919fdb0c-6716-4869-8320-0659978bcdc6 service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-e78ff296-3c80-4587-b0c3-9a9f4aa4614d req-919fdb0c-6716-4869-8320-0659978bcdc6 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] No waiting events found dispatching network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:27 user nova-compute[75071]: WARNING nova.compute.manager [req-e78ff296-3c80-4587-b0c3-9a9f4aa4614d req-919fdb0c-6716-4869-8320-0659978bcdc6 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received unexpected event network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a for instance with vm_state building and task_state spawning.
Nov 29 13:40:27 user nova-compute[75071]: INFO nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 29 13:40:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:40:27 user nova-compute[75071]: INFO nova.compute.manager [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Took 7.27 seconds to build instance.
Nov 29 13:40:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a0638f5d-a8eb-4e9d-a246-dc41a90f2129 tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.389s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-changed-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Refreshing instance network info cache due to event network-changed-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] Acquiring lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] Acquired lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Refreshing network info cache for port 79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updated VIF entry in instance network info cache for port 79cb4319-9bf2-44a6-a4ad-2becc5eb64ae. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updating instance_info_cache with network_info: [{"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:40:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0891bfa1-d9ca-4531-a1f6-cd535d74e344 req-e7f15a4d-0d69-4594-bdfc-68fc7a89924b service nova] Releasing lock "refresh_cache-a2b15e2b-3416-4a1d-971e-e9ffb1de396d" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:40:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:34 user nova-compute[75071]: INFO nova.compute.manager [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Attaching volume 98bb0da3-1aac-4954-b837-ade0695c2a9f to /dev/vdb
Nov 29 13:40:34 user nova-compute[75071]: DEBUG os_brick.utils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b97b4-4383-47fe-aa11-726b32d390c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a639184-c435-4bfa-8149-cd31f9532f27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea49f146-23ce-479f-bd72-055fce80203a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca5b5c1-2fbb-4858-9088-e03a81cd9d2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:40:34 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:40:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd16da6b-08f0-429c-bee0-822a7bcd2800]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG os_brick.utils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:40:34 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updating existing volume attachment record: bab3d0f7-6e37-4701-928b-5baf62b3a704 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:40:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srTqXeYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:40:42 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:40:42 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:40:42 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[81548878-9e1d-4862-92c2-787239451dfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:40:42 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aeb07e-18c5-462b-8aa3-f565ce61516d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f] added
Nov 29 13:40:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8293515-2c21-4522-90b6-da2b84e85780]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf3fa47-6d78-4674-a88a-955dae13ee77]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srTqXeYl {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srTqXeYl" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b43f27-4115-45af-b11a-0540f93049ef]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srTqXeYl'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d74fc16-cfc8-4b8c-9133-f8b5dc2ea663]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d63668-bf4a-42d6-9884-51fa9a064cb8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7e9839-9275-4219-9533-9cd349944660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260]
Nov 29 13:40:42 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260] successful.
Nov 29 13:40:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56c87da-5281-4adc-ade5-5ea93c012005]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ed1f2f-0241-4bcb-9762-36908623b0c1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:40:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:42 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:40:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b1a6a0-483b-4be2-9c5f-1d2e53c62b5d]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:40:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srTqXeYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:40:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:40:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26636323964363531', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:40:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636323964363531', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:40:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:40:43 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:40:43 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:40:43 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:40:43 user nova-compute[75071]:   <serial>98bb0da3-1aac-4954-b837-ade0695c2a9f</serial>
Nov 29 13:40:43 user nova-compute[75071]: </disk>
Nov 29 13:40:43 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:40:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:40:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:40:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No VIF found with MAC fa:16:3e:dc:3c:46, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:40:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d64ffd42-9614-4b5f-b426-9be2dc835f1a tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.913s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:48 user nova-compute[75071]: INFO nova.compute.manager [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Attaching volume 676edfaf-0388-4097-b5cf-4125f2e23437 to /dev/vdc
Nov 29 13:40:48 user nova-compute[75071]: DEBUG os_brick.utils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276927a-605e-4770-b245-bd21d89f45cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b798c983-55bc-4b47-ad93-2a3ac6c62425]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[582ba34c-4791-4011-8a51-cb9602979ff4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e12e1c-a13d-4887-9861-3f262446d2c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:40:48 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:40:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[782a3e3c-8673-4b51-9127-91d2075a139d]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG os_brick.utils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updating existing volume attachment record: 64d90b40-be61-4469-87e0-bd3614f8dd85 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:40:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fcb58221-096b-4275-874f-efb5043b610b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:51 user nova-compute[75071]: INFO nova.compute.manager [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Terminating instance
Nov 29 13:40:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-73685f47-dbfe-4bae-9473-75cbfc6021dd req-796b8815-d268-4d4b-a875-603062371bdc service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received event network-vif-unplugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73685f47-dbfe-4bae-9473-75cbfc6021dd req-796b8815-d268-4d4b-a875-603062371bdc service nova] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73685f47-dbfe-4bae-9473-75cbfc6021dd req-796b8815-d268-4d4b-a875-603062371bdc service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73685f47-dbfe-4bae-9473-75cbfc6021dd req-796b8815-d268-4d4b-a875-603062371bdc service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-73685f47-dbfe-4bae-9473-75cbfc6021dd req-796b8815-d268-4d4b-a875-603062371bdc service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] No waiting events found dispatching network-vif-unplugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-73685f47-dbfe-4bae-9473-75cbfc6021dd req-796b8815-d268-4d4b-a875-603062371bdc service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received event network-vif-unplugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: fcb58221-096b-4275-874f-efb5043b610b] Instance destroyed successfully.
Nov 29 13:40:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'resources' on Instance uuid fcb58221-096b-4275-874f-efb5043b610b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:31:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2118985663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2118985663',id=30,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-lrxa2tat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:33:26Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=fcb58221-096b-4275-874f-efb5043b610b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "address": "fa:16:3e:fa:21:f5", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d08334b-3a", "ovs_interfaceid": "9d08334b-3a27-45ee-8f5c-a6cf4d2654d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:21:f5,bridge_name='br-int',has_traffic_filtering=True,id=9d08334b-3a27-45ee-8f5c-a6cf4d2654d6,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d08334b-3a') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG os_vif [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:21:f5,bridge_name='br-int',has_traffic_filtering=True,id=9d08334b-3a27-45ee-8f5c-a6cf4d2654d6,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d08334b-3a') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d08334b-3a, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afb92b42-cbd3-4f53-82ae-27b91e054ad4) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:52 user nova-compute[75071]: INFO os_vif [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:21:f5,bridge_name='br-int',has_traffic_filtering=True,id=9d08334b-3a27-45ee-8f5c-a6cf4d2654d6,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d08334b-3a')
Nov 29 13:40:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Deleting instance files /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b_del
Nov 29 13:40:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Deletion of /opt/stack/data/nova/instances/fcb58221-096b-4275-874f-efb5043b610b_del complete
Nov 29 13:40:52 user nova-compute[75071]: INFO nova.compute.manager [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: fcb58221-096b-4275-874f-efb5043b610b] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 29 13:40:52 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: fcb58221-096b-4275-874f-efb5043b610b] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: fcb58221-096b-4275-874f-efb5043b610b] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:40:53 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: fcb58221-096b-4275-874f-efb5043b610b] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:40:53 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: fcb58221-096b-4275-874f-efb5043b610b] Took 0.93 seconds to deallocate network for instance.
Nov 29 13:40:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:40:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:40:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:53 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Deleted allocations for instance fcb58221-096b-4275-874f-efb5043b610b
Nov 29 13:40:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008fd50c-a472-4205-8d35-87808aeb0161 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "fcb58221-096b-4275-874f-efb5043b610b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-d2e1abe5-4248-4313-96d7-bfe85cb32ea1 req-a3abb778-b0c3-4bec-bab1-6b364e1a5736 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received event network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d2e1abe5-4248-4313-96d7-bfe85cb32ea1 req-a3abb778-b0c3-4bec-bab1-6b364e1a5736 service nova] Acquiring lock "fcb58221-096b-4275-874f-efb5043b610b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d2e1abe5-4248-4313-96d7-bfe85cb32ea1 req-a3abb778-b0c3-4bec-bab1-6b364e1a5736 service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d2e1abe5-4248-4313-96d7-bfe85cb32ea1 req-a3abb778-b0c3-4bec-bab1-6b364e1a5736 service nova] Lock "fcb58221-096b-4275-874f-efb5043b610b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-d2e1abe5-4248-4313-96d7-bfe85cb32ea1 req-a3abb778-b0c3-4bec-bab1-6b364e1a5736 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] No waiting events found dispatching network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:40:54 user nova-compute[75071]: WARNING nova.compute.manager [req-d2e1abe5-4248-4313-96d7-bfe85cb32ea1 req-a3abb778-b0c3-4bec-bab1-6b364e1a5736 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received unexpected event network-vif-plugged-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 for instance with vm_state deleted and task_state None.
Nov 29 13:40:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-d2e1abe5-4248-4313-96d7-bfe85cb32ea1 req-a3abb778-b0c3-4bec-bab1-6b364e1a5736 service nova] [instance: fcb58221-096b-4275-874f-efb5043b610b] Received event network-vif-deleted-9d08334b-3a27-45ee-8f5c-a6cf4d2654d6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:40:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BymVwEtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:40:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:40:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:40:55 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a09983-ea8b-497c-a3bf-2e1fc19d7210]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:40:55 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c6bc64-ee04-42a9-8288-fbf4c8917202]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437] added
Nov 29 13:40:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d9417-35b2-499d-961b-21eb075be279]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbabf69-8774-48b7-9861-709e7fcd36b9]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BymVwEtZ {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BymVwEtZ" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b07bc1b-e738-4fb3-ae2f-e855e60c7846]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BymVwEtZ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7ef5e-fbc6-456c-92bb-8cc284a433cf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca48356-6987-49ed-b750-fba37df67a6c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:55 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:55 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:40:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:55 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:55 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:40:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:40:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4e617c-0c6f-4b1b-a23a-ae7c6da3a882]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260]
Nov 29 13:40:56 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260] successful.
Nov 29 13:40:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd4340d-39d1-4630-8b90-6afe559a4287]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f426446-8b29-4b1a-a507-89b93fcaf9b9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:56 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:56 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:40:56 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)
Nov 29 13:40:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:40:56 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:40:56 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:40:56 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)
Nov 29 13:40:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e890f-de3a-4fff-bfc0-587892cab04c]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BymVwEtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:40:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26565343738613735', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565343738613735', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:40:57 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:40:57 user nova-compute[75071]:   <source dev="/dev/sde"/>
Nov 29 13:40:57 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:40:57 user nova-compute[75071]:   <serial>676edfaf-0388-4097-b5cf-4125f2e23437</serial>
Nov 29 13:40:57 user nova-compute[75071]: </disk>
Nov 29 13:40:57 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] No VIF found with MAC fa:16:3e:dc:3c:46, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a2c076cf-a9d1-4335-a915-4f02e95ddd60 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.655s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:40:59 user nova-compute[75071]: INFO nova.compute.manager [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Detaching volume 98bb0da3-1aac-4954-b837-ade0695c2a9f
Nov 29 13:40:59 user nova-compute[75071]: INFO nova.virt.block_device [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Attempting to driver detach volume 98bb0da3-1aac-4954-b837-ade0695c2a9f from mountpoint /dev/vdb
Nov 29 13:40:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Attempting to detach device vdb from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:40:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:40:59 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:40:59 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:40:59 user nova-compute[75071]:   <serial>98bb0da3-1aac-4954-b837-ade0695c2a9f</serial>
Nov 29 13:40:59 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:40:59 user nova-compute[75071]: </disk>
Nov 29 13:40:59 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:40:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully detached device vdb from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the persistent domain config.
Nov 29 13:40:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:40:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:40:59 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:40:59 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:40:59 user nova-compute[75071]:   <serial>98bb0da3-1aac-4954-b837-ade0695c2a9f</serial>
Nov 29 13:40:59 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:40:59 user nova-compute[75071]: </disk>
Nov 29 13:40:59 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:40:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:41:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:41:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:41:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:41:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid a0bdb312-835a-499a-af02-58f5f25f50e9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:41:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updating instance_info_cache with network_info: [{"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:41:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-a0bdb312-835a-499a-af02-58f5f25f50e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:41:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:41:01 user nova-compute[75071]: INFO nova.compute.claims [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Claim successful on node user
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:41:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:41:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Creating image(s)
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "/opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "/opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "/opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG nova.policy [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '954c5e550bad4513baae53999a84f7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a39e332f274492869c06dc515bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:41:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk 1073741824" returned: 0 in 0.055s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Successfully created port: 5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Cannot resize image /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Ensure instance console log exists: /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Successfully updated port: 5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "refresh_cache-527ab85b-ccbf-42a4-94c8-fb35cb9b058f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquired lock "refresh_cache-527ab85b-ccbf-42a4-94c8-fb35cb9b058f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received event network-changed-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Refreshing instance network info cache due to event network-changed-5fdc2125-b4aa-41d2-92ca-45063018eb97. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] Acquiring lock "refresh_cache-527ab85b-ccbf-42a4-94c8-fb35cb9b058f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Updating instance_info_cache with network_info: [{"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Releasing lock "refresh_cache-527ab85b-ccbf-42a4-94c8-fb35cb9b058f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Instance network_info: |[{"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] Acquired lock "refresh_cache-527ab85b-ccbf-42a4-94c8-fb35cb9b058f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Refreshing network info cache for port 5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Start _get_guest_xml network_info=[{"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:41:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:41:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:41:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1793513750',display_name='tempest-VolumesNegativeTest-instance-1793513750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1793513750',id=43,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5a39e332f274492869c06dc515bcbb0',ramdisk_id='',reservation_id='r-hxmdxomx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1864574974',owner_user_name='tempest-VolumesNegativeTest-1864574974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:41:02Z,user_data=None,user_id='954c5e550bad4513baae53999a84f7d3',uuid=527ab85b-ccbf-42a4-94c8-fb35cb9b058f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Converting VIF {"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e9:83,bridge_name='br-int',has_traffic_filtering=True,id=5fdc2125-b4aa-41d2-92ca-45063018eb97,network=Network(4e464a29-054c-4b44-8fa1-cc6e3e1cd42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdc2125-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lazy-loading 'pci_devices' on Instance uuid 527ab85b-ccbf-42a4-94c8-fb35cb9b058f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:41:03 user nova-compute[75071]:   <uuid>527ab85b-ccbf-42a4-94c8-fb35cb9b058f</uuid>
Nov 29 13:41:03 user nova-compute[75071]:   <name>instance-0000002b</name>
Nov 29 13:41:03 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:41:03 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:41:03 user nova-compute[75071]:   <metadata>
Nov 29 13:41:03 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:41:03 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:41:03 user nova-compute[75071]:       <nova:name>tempest-VolumesNegativeTest-instance-1793513750</nova:name>
Nov 29 13:41:03 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:41:03</nova:creationTime>
Nov 29 13:41:03 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:41:03 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:41:03 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:41:03 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:41:03 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:41:03 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:41:03 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:41:03 user nova-compute[75071]:       <nova:owner>
Nov 29 13:41:03 user nova-compute[75071]:         <nova:user uuid="954c5e550bad4513baae53999a84f7d3">tempest-VolumesNegativeTest-1864574974-project-member</nova:user>
Nov 29 13:41:03 user nova-compute[75071]:         <nova:project uuid="c5a39e332f274492869c06dc515bcbb0">tempest-VolumesNegativeTest-1864574974</nova:project>
Nov 29 13:41:03 user nova-compute[75071]:       </nova:owner>
Nov 29 13:41:03 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:41:03 user nova-compute[75071]:       <nova:ports>
Nov 29 13:41:03 user nova-compute[75071]:         <nova:port uuid="5fdc2125-b4aa-41d2-92ca-45063018eb97">
Nov 29 13:41:03 user nova-compute[75071]:           <nova:ip type="fixed" address="192.168.233.76" ipVersion="4"/>
Nov 29 13:41:03 user nova-compute[75071]:         </nova:port>
Nov 29 13:41:03 user nova-compute[75071]:       </nova:ports>
Nov 29 13:41:03 user nova-compute[75071]:     </nova:instance>
Nov 29 13:41:03 user nova-compute[75071]:   </metadata>
Nov 29 13:41:03 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:41:03 user nova-compute[75071]:     <system>
Nov 29 13:41:03 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:41:03 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:41:03 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:41:03 user nova-compute[75071]:       <entry name="serial">527ab85b-ccbf-42a4-94c8-fb35cb9b058f</entry>
Nov 29 13:41:03 user nova-compute[75071]:       <entry name="uuid">527ab85b-ccbf-42a4-94c8-fb35cb9b058f</entry>
Nov 29 13:41:03 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:41:03 user nova-compute[75071]:     </system>
Nov 29 13:41:03 user nova-compute[75071]:   </sysinfo>
Nov 29 13:41:03 user nova-compute[75071]:   <os>
Nov 29 13:41:03 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:41:03 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:41:03 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:41:03 user nova-compute[75071]:   </os>
Nov 29 13:41:03 user nova-compute[75071]:   <features>
Nov 29 13:41:03 user nova-compute[75071]:     <acpi/>
Nov 29 13:41:03 user nova-compute[75071]:     <apic/>
Nov 29 13:41:03 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:41:03 user nova-compute[75071]:   </features>
Nov 29 13:41:03 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:41:03 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:41:03 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:41:03 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:41:03 user nova-compute[75071]:   </clock>
Nov 29 13:41:03 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:41:03 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:41:03 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:41:03 user nova-compute[75071]:   </cpu>
Nov 29 13:41:03 user nova-compute[75071]:   <devices>
Nov 29 13:41:03 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:41:03 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:41:03 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk"/>
Nov 29 13:41:03 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:41:03 user nova-compute[75071]:     </disk>
Nov 29 13:41:03 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:41:03 user nova-compute[75071]:       <mac address="fa:16:3e:4d:e9:83"/>
Nov 29 13:41:03 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:41:03 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:41:03 user nova-compute[75071]:       <target dev="tap5fdc2125-b4"/>
Nov 29 13:41:03 user nova-compute[75071]:     </interface>
Nov 29 13:41:03 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:41:03 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/console.log" append="off"/>
Nov 29 13:41:03 user nova-compute[75071]:     </serial>
Nov 29 13:41:03 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:41:03 user nova-compute[75071]:     <video>
Nov 29 13:41:03 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:41:03 user nova-compute[75071]:     </video>
Nov 29 13:41:03 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:41:03 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:41:03 user nova-compute[75071]:     </rng>
Nov 29 13:41:03 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:41:03 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:41:03 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:41:03 user nova-compute[75071]:     </memballoon>
Nov 29 13:41:03 user nova-compute[75071]:   </devices>
Nov 29 13:41:03 user nova-compute[75071]: </domain>
Nov 29 13:41:03 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:41:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1793513750',display_name='tempest-VolumesNegativeTest-instance-1793513750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1793513750',id=43,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5a39e332f274492869c06dc515bcbb0',ramdisk_id='',reservation_id='r-hxmdxomx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1864574974',owner_user_name='tempest-VolumesNegativeTest-1864574974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:41:02Z,user_data=None,user_id='954c5e550bad4513baae53999a84f7d3',uuid=527ab85b-ccbf-42a4-94c8-fb35cb9b058f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Converting VIF {"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e9:83,bridge_name='br-int',has_traffic_filtering=True,id=5fdc2125-b4aa-41d2-92ca-45063018eb97,network=Network(4e464a29-054c-4b44-8fa1-cc6e3e1cd42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdc2125-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG os_vif [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e9:83,bridge_name='br-int',has_traffic_filtering=True,id=5fdc2125-b4aa-41d2-92ca-45063018eb97,network=Network(4e464a29-054c-4b44-8fa1-cc6e3e1cd42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdc2125-b4') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79d994b8-9734-5907-aa34-c51ad44d438a', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fdc2125-b4, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fdc2125-b4, col_values=(('qos', UUID('d238ed7d-faa3-47d3-a888-25c7e04b55d0')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fdc2125-b4, col_values=(('external_ids', {'iface-id': '5fdc2125-b4aa-41d2-92ca-45063018eb97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:e9:83', 'vm-uuid': '527ab85b-ccbf-42a4-94c8-fb35cb9b058f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:03 user nova-compute[75071]: INFO os_vif [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e9:83,bridge_name='br-int',has_traffic_filtering=True,id=5fdc2125-b4aa-41d2-92ca-45063018eb97,network=Network(4e464a29-054c-4b44-8fa1-cc6e3e1cd42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdc2125-b4')
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] No VIF found with MAC fa:16:3e:4d:e9:83, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Updated VIF entry in instance network info cache for port 5fdc2125-b4aa-41d2-92ca-45063018eb97. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Updating instance_info_cache with network_info: [{"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-831db7e6-7365-4ca8-866a-1d15e96f2613 req-e4c005cc-23d2-44bc-bab8-e6d06e813ed2 service nova] Releasing lock "refresh_cache-527ab85b-ccbf-42a4-94c8-fb35cb9b058f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:05 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:41:05 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8027MB free_disk=24.915321350097656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance bd444771-6b7d-4297-bfbe-86efe908b8fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 527ab85b-ccbf-42a4-94c8-fb35cb9b058f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d8736ea-d882-4f98-a7e4-5fea9065f4dd req-950a0dca-9bd6-4464-ae68-5f0bd175ae9c service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received event network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d8736ea-d882-4f98-a7e4-5fea9065f4dd req-950a0dca-9bd6-4464-ae68-5f0bd175ae9c service nova] Acquiring lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d8736ea-d882-4f98-a7e4-5fea9065f4dd req-950a0dca-9bd6-4464-ae68-5f0bd175ae9c service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d8736ea-d882-4f98-a7e4-5fea9065f4dd req-950a0dca-9bd6-4464-ae68-5f0bd175ae9c service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d8736ea-d882-4f98-a7e4-5fea9065f4dd req-950a0dca-9bd6-4464-ae68-5f0bd175ae9c service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] No waiting events found dispatching network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:05 user nova-compute[75071]: WARNING nova.compute.manager [req-4d8736ea-d882-4f98-a7e4-5fea9065f4dd req-950a0dca-9bd6-4464-ae68-5f0bd175ae9c service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received unexpected event network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 for instance with vm_state building and task_state spawning.
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:41:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.758s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:41:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Instance spawned successfully.
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:41:07 user nova-compute[75071]: INFO nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:41:07 user nova-compute[75071]: INFO nova.compute.manager [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Took 6.49 seconds to build instance.
Nov 29 13:41:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1e3936-3eae-4c4b-998b-59d8ccbd1ac0 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.582s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-43915650-c81c-462d-a8e5-21b9c035bc05 req-eab92a68-95a4-4096-88fa-ccd5704c30cc service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received event network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43915650-c81c-462d-a8e5-21b9c035bc05 req-eab92a68-95a4-4096-88fa-ccd5704c30cc service nova] Acquiring lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43915650-c81c-462d-a8e5-21b9c035bc05 req-eab92a68-95a4-4096-88fa-ccd5704c30cc service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43915650-c81c-462d-a8e5-21b9c035bc05 req-eab92a68-95a4-4096-88fa-ccd5704c30cc service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-43915650-c81c-462d-a8e5-21b9c035bc05 req-eab92a68-95a4-4096-88fa-ccd5704c30cc service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] No waiting events found dispatching network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:07 user nova-compute[75071]: WARNING nova.compute.manager [req-43915650-c81c-462d-a8e5-21b9c035bc05 req-eab92a68-95a4-4096-88fa-ccd5704c30cc service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received unexpected event network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 for instance with vm_state active and task_state None.
Nov 29 13:41:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:41:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:41:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d is timed out.
Nov 29 13:41:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully detached device vdb from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the live domain config.
Nov 29 13:41:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srTqXeYl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:41:19 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86628e28-9c2b-4644-b205-ce11fb2e616d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:41:20 user nova-compute[75071]: No targets found.
Nov 29 13:41:20 user nova-compute[75071]: iSNS:
Nov 29 13:41:20 user nova-compute[75071]: No targets found.
Nov 29 13:41:20 user nova-compute[75071]: STATIC:
Nov 29 13:41:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437
Nov 29 13:41:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:41:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f
Nov 29 13:41:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135
Nov 29 13:41:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:20 user nova-compute[75071]: FIRMWARE:
Nov 29 13:41:20 user nova-compute[75071]: No targets found.
Nov 29 13:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:41:20 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:41:20 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f82810-4300-427f-a5db-28958b866807]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85664d5-56c2-4185-800f-25f4fd697977]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:41:20 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:41:20 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:41:20 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)
Nov 29 13:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:41:20 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:41:20 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f (non-flash)
Nov 29 13:41:20 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)
Nov 29 13:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f21484c3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbc64a4-7640-46a7-a4e6-9e4909983457]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c62ff6-54fd-4407-bd89-7f0deb315313]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd865d5-48e4-4635-bd42-b2c9e2736a54]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.027s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c600e9-a4b7-4cf1-b39d-01b5abd66228]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46102cc7-4207-4ebd-a5bf-bc9f80e004ec]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d4c51b-531f-434f-a3e3-f56ff34c0bf0]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260]
Nov 29 13:41:20 user nova-compute[75071]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f, portal: 172.16.0.220,3260] successful.
Nov 29 13:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98bb0da3-1aac-4954-b837-ade0695c2a9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42769b76-e943-42f2-be3c-57efd35afdcf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== disconnect_volume: return (296ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:41:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:41:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:41:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a46a824-4f96-4830-af00-5e7b9d1e6faf tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:21 user nova-compute[75071]: INFO nova.compute.manager [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Detaching volume 676edfaf-0388-4097-b5cf-4125f2e23437
Nov 29 13:41:22 user nova-compute[75071]: INFO nova.virt.block_device [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Attempting to driver detach volume 676edfaf-0388-4097-b5cf-4125f2e23437 from mountpoint /dev/vdc
Nov 29 13:41:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Attempting to detach device vdc from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:41:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:41:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:41:22 user nova-compute[75071]:   <source dev="/dev/sde"/>
Nov 29 13:41:22 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:41:22 user nova-compute[75071]:   <serial>676edfaf-0388-4097-b5cf-4125f2e23437</serial>
Nov 29 13:41:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 13:41:22 user nova-compute[75071]: </disk>
Nov 29 13:41:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:41:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully detached device vdc from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the persistent domain config.
Nov 29 13:41:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:41:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:41:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:41:22 user nova-compute[75071]:   <source dev="/dev/sde"/>
Nov 29 13:41:22 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:41:22 user nova-compute[75071]:   <serial>676edfaf-0388-4097-b5cf-4125f2e23437</serial>
Nov 29 13:41:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 13:41:22 user nova-compute[75071]: </disk>
Nov 29 13:41:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:41:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:41:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:42 user nova-compute[75071]: INFO nova.compute.manager [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Terminating instance
Nov 29 13:41:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d is timed out.
Nov 29 13:41:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully detached device vdc from instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d from the live domain config.
Nov 29 13:41:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BymVwEtZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:41:42 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-de472bb8-27c8-4beb-8825-e4c9c470b57a req-578f51e5-3e7c-4d95-9891-bf040b43e5d6 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de472bb8-27c8-4beb-8825-e4c9c470b57a req-578f51e5-3e7c-4d95-9891-bf040b43e5d6 service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de472bb8-27c8-4beb-8825-e4c9c470b57a req-578f51e5-3e7c-4d95-9891-bf040b43e5d6 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de472bb8-27c8-4beb-8825-e4c9c470b57a req-578f51e5-3e7c-4d95-9891-bf040b43e5d6 service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-de472bb8-27c8-4beb-8825-e4c9c470b57a req-578f51e5-3e7c-4d95-9891-bf040b43e5d6 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-de472bb8-27c8-4beb-8825-e4c9c470b57a req-578f51e5-3e7c-4d95-9891-bf040b43e5d6 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-unplugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502036e-c1f2-4c37-999b-693c3fd44ed5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:41:42 user nova-compute[75071]: No targets found.
Nov 29 13:41:42 user nova-compute[75071]: iSNS:
Nov 29 13:41:42 user nova-compute[75071]: No targets found.
Nov 29 13:41:42 user nova-compute[75071]: STATIC:
Nov 29 13:41:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437
Nov 29 13:41:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:41:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135
Nov 29 13:41:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:42 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:42 user nova-compute[75071]: FIRMWARE:
Nov 29 13:41:42 user nova-compute[75071]: No targets found.
Nov 29 13:41:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:41:42 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:41:42 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a72d3a-2afc-499c-9197-12421017ec90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ae3950-4944-4b41-a82d-341c0aec9257]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:41:42 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:41:42 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)
Nov 29 13:41:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:41:42 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:41:42 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 (non-flash)
Nov 29 13:41:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f216c5f7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3003f7d-f063-4a84-bb37-44f0bdaa95b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0928ee-9e6b-44ad-ac03-075490ff02f2]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf40431-ba77-4a88-b6d1-d8e76bf7b439]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5fc182-3e5c-4277-9fa4-e2b2643844d8]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae63407-19a3-47af-a015-a6ff4b049fd8]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc157d-c2fd-4fce-9465-63dbe96111c7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260]
Nov 29 13:41:42 user nova-compute[75071]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437, portal: 172.16.0.220,3260] successful.
Nov 29 13:41:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:676edfaf-0388-4097-b5cf-4125f2e23437 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9869a25-d264-470e-a15a-c2137ae2f0bf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] <== disconnect_volume: return (385ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:41:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:41:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Instance destroyed successfully.
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'resources' on Instance uuid 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-693445275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-693445275',id=21,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:27:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-3r3k8o12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:29:43Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "45921a18-24fc-47db-a80d-93de497a66e8", "address": "fa:16:3e:bb:24:2b", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45921a18-24", "ovs_interfaceid": "45921a18-24fc-47db-a80d-93de497a66e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_vif [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45921a18-24, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ddbe543-d64b-4efe-a8a1-4227317a129f) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:41:43 user nova-compute[75071]: INFO os_vif [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:24:2b,bridge_name='br-int',has_traffic_filtering=True,id=45921a18-24fc-47db-a80d-93de497a66e8,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45921a18-24')
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcqzUwCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:41:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674be36-5375-4163-9789-34863a77f38c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:41:43 user nova-compute[75071]: No targets found.
Nov 29 13:41:43 user nova-compute[75071]: iSNS:
Nov 29 13:41:43 user nova-compute[75071]: No targets found.
Nov 29 13:41:43 user nova-compute[75071]: STATIC:
Nov 29 13:41:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36
Nov 29 13:41:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135
Nov 29 13:41:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:41:43 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:41:43 user nova-compute[75071]: FIRMWARE:
Nov 29 13:41:43 user nova-compute[75071]: No targets found.
Nov 29 13:41:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:41:43 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:41:43 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c0bc7-cfe2-45ac-bd65-e489e48a59b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3de8ba-bd8c-4657-8cde-415829fdb8a7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:41:43 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:41:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 (non-flash)
Nov 29 13:41:43 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:41:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124fe08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fddc2e9-eef7-4c2f-98a6-77d90352ef1d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f1ddb4-12e1-48db-80f1-d613a7bb5fb3]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7153747-e50f-4aba-bb2e-5cd5e88f42d0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201e8f4-7842-4c06-b4d4-e73562e83ab7]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ff433-67d8-4961-b8ea-3ed55d17c966]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c89950-6ebf-42d8-b8f0-7c853a588fec]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260]
Nov 29 13:41:43 user nova-compute[75071]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36, portal: 172.16.0.220,3260] successful.
Nov 29 13:41:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a68cb5f-f7ab-4658-9c53-3d2ac8fe3e36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50d40e0-b97d-40c9-ae99-038cfa09c4e0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] <== disconnect_volume: return (287ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:41:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Deleting instance files /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d_del
Nov 29 13:41:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Deletion of /opt/stack/data/nova/instances/7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d_del complete
Nov 29 13:41:43 user nova-compute[75071]: INFO nova.compute.manager [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'flavor' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:41:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-51fe555e-c12b-43d7-965f-a87e0fb49f40 tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:41:44 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Took 0.65 seconds to deallocate network for instance.
Nov 29 13:41:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-050ada30-972d-46d9-a9c3-d22921489f19 req-099579a4-7ae2-4291-9c99-7652a4781849 service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-deleted-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-679a9be9-6de9-4877-99da-b4d0e7f69025 req-6888f918-3877-48e5-af14-70da118625dc service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-679a9be9-6de9-4877-99da-b4d0e7f69025 req-6888f918-3877-48e5-af14-70da118625dc service nova] Acquiring lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-679a9be9-6de9-4877-99da-b4d0e7f69025 req-6888f918-3877-48e5-af14-70da118625dc service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-679a9be9-6de9-4877-99da-b4d0e7f69025 req-6888f918-3877-48e5-af14-70da118625dc service nova] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-679a9be9-6de9-4877-99da-b4d0e7f69025 req-6888f918-3877-48e5-af14-70da118625dc service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] No waiting events found dispatching network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:44 user nova-compute[75071]: WARNING nova.compute.manager [req-679a9be9-6de9-4877-99da-b4d0e7f69025 req-6888f918-3877-48e5-af14-70da118625dc service nova] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Received unexpected event network-vif-plugged-45921a18-24fc-47db-a80d-93de497a66e8 for instance with vm_state active and task_state deleting.
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:44 user nova-compute[75071]: INFO nova.compute.manager [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Terminating instance
Nov 29 13:41:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:41:44 user nova-compute[75071]: INFO nova.compute.manager [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d] Took 0.87 seconds to detach 1 volumes for instance.
Nov 29 13:41:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:45 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Deleted allocations for instance 7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d
Nov 29 13:41:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-845da4ba-240d-40ae-a9de-4146140c51b3 tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "7971d643-4dd6-4550-b1e9-a8dc1aaa9e0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Instance destroyed successfully.
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lazy-loading 'resources' on Instance uuid a2b15e2b-3416-4a1d-971e-e9ffb1de396d {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-43361750',display_name='tempest-AttachVolumeTestJSON-server-43361750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-43361750',id=40,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOw2bwXMtvL5KYzotuKXufhMHXskXj2NTLJB+2WY//vmqmSfXKB34/mruZ6VUmcyicDkPI752aq8/8MPY4a3C3iSZVOhMc2efIL38PXQUqEe7oEOx4NFTB8UIVbHxskdw==',key_name='tempest-keypair-849444990',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:38:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fead1ec3dc0456eb2dd2290009247a9',ramdisk_id='',reservation_id='r-r3lf231e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-964246432',owner_user_name='tempest-AttachVolumeTestJSON-964246432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:38:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b78150bab7440daf6d7fe0d25d4cf2',uuid=a2b15e2b-3416-4a1d-971e-e9ffb1de396d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converting VIF {"id": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "address": "fa:16:3e:dc:3c:46", "network": {"id": "2522fac9-cff1-4624-978b-4cb3abc978eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-999697700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fead1ec3dc0456eb2dd2290009247a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79cb4319-9b", "ovs_interfaceid": "79cb4319-9bf2-44a6-a4ad-2becc5eb64ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3c:46,bridge_name='br-int',has_traffic_filtering=True,id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb4319-9b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG os_vif [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3c:46,bridge_name='br-int',has_traffic_filtering=True,id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb4319-9b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79cb4319-9b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e57778aa-483f-485e-8bf0-fcfff7402771) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:41:45 user nova-compute[75071]: INFO os_vif [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:3c:46,bridge_name='br-int',has_traffic_filtering=True,id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae,network=Network(2522fac9-cff1-4624-978b-4cb3abc978eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79cb4319-9b')
Nov 29 13:41:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Deleting instance files /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d_del
Nov 29 13:41:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Deletion of /opt/stack/data/nova/instances/a2b15e2b-3416-4a1d-971e-e9ffb1de396d_del complete
Nov 29 13:41:45 user nova-compute[75071]: INFO nova.compute.manager [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 13:41:45 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:41:45 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-unplugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-unplugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-unplugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:46 user nova-compute[75071]: WARNING nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received unexpected event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with vm_state active and task_state deleting.
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:46 user nova-compute[75071]: WARNING nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received unexpected event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with vm_state active and task_state deleting.
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:46 user nova-compute[75071]: WARNING nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received unexpected event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with vm_state active and task_state deleting.
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-unplugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-unplugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e185fa8-9323-4489-af72-8f95694475ef req-5f3a9d34-7951-46fe-9756-9dea0498f5a0 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-unplugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-b5e75767-f0f3-4e44-a881-8a9ff442c30e req-8ed6c172-8e00-49ad-a23e-c782f5a78e53 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-deleted-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:46 user nova-compute[75071]: INFO nova.compute.manager [req-b5e75767-f0f3-4e44-a881-8a9ff442c30e req-8ed6c172-8e00-49ad-a23e-c782f5a78e53 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Neutron deleted interface 79cb4319-9bf2-44a6-a4ad-2becc5eb64ae; detaching it from the instance and deleting it from the info cache
Nov 29 13:41:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-b5e75767-f0f3-4e44-a881-8a9ff442c30e req-8ed6c172-8e00-49ad-a23e-c782f5a78e53 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:41:47 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:41:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-b5e75767-f0f3-4e44-a881-8a9ff442c30e req-8ed6c172-8e00-49ad-a23e-c782f5a78e53 service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Detach interface failed, port_id=79cb4319-9bf2-44a6-a4ad-2becc5eb64ae, reason: Instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:41:47 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Took 1.17 seconds to deallocate network for instance.
Nov 29 13:41:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:47 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:41:47 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:41:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:47 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Deleted allocations for instance a2b15e2b-3416-4a1d-971e-e9ffb1de396d
Nov 29 13:41:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-29011cf0-a27a-4aa6-8300-0d0c2876513e tempest-AttachVolumeTestJSON-964246432 tempest-AttachVolumeTestJSON-964246432-project-member] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.650s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-72260d31-8300-4185-88e1-ad6772dfce76 req-92c4fe44-adbe-4102-adaf-22ac04500b7c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72260d31-8300-4185-88e1-ad6772dfce76 req-92c4fe44-adbe-4102-adaf-22ac04500b7c service nova] Acquiring lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:41:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72260d31-8300-4185-88e1-ad6772dfce76 req-92c4fe44-adbe-4102-adaf-22ac04500b7c service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:41:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72260d31-8300-4185-88e1-ad6772dfce76 req-92c4fe44-adbe-4102-adaf-22ac04500b7c service nova] Lock "a2b15e2b-3416-4a1d-971e-e9ffb1de396d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:41:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-72260d31-8300-4185-88e1-ad6772dfce76 req-92c4fe44-adbe-4102-adaf-22ac04500b7c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] No waiting events found dispatching network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:41:48 user nova-compute[75071]: WARNING nova.compute.manager [req-72260d31-8300-4185-88e1-ad6772dfce76 req-92c4fe44-adbe-4102-adaf-22ac04500b7c service nova] [instance: a2b15e2b-3416-4a1d-971e-e9ffb1de396d] Received unexpected event network-vif-plugged-79cb4319-9bf2-44a6-a4ad-2becc5eb64ae for instance with vm_state deleted and task_state None.
Nov 29 13:41:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:41:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:41:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:41:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:41:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:41:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:41:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-changed-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Refreshing instance network info cache due to event network-changed-acf66a52-04f9-4e47-8fa0-b4785a8227e3. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] Acquiring lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] Acquired lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Refreshing network info cache for port acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updated VIF entry in instance network info cache for port acf66a52-04f9-4e47-8fa0-b4785a8227e3. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating instance_info_cache with network_info: [{"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2decc5aa-b25f-4bac-b774-3b1f967d31c9 req-cc680141-26b2-463a-b18d-6ffd1d009b1d service nova] Releasing lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:41:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:42:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:42:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:42:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:42:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:04 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:42:04 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8070MB free_disk=24.904953002929688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance a0bdb312-835a-499a-af02-58f5f25f50e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance bd444771-6b7d-4297-bfbe-86efe908b8fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 527ab85b-ccbf-42a4-94c8-fb35cb9b058f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "1b7510aa-f55b-48bf-8d7a-6807dab59057" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:42:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:42:06 user nova-compute[75071]: INFO nova.compute.claims [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Claim successful on node user
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:42:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.policy [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32b037a2bbef4090a2317bfeedd8e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b75ecae6764ce1801dbab6253ac6c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:42:07 user nova-compute[75071]: INFO nova.virt.block_device [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Booting with volume 798f58ef-e03d-453c-89dd-89a35c315d3f at /dev/vda
Nov 29 13:42:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c57146c-7b53-48a5-aada-e90c9970ba9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af1dffb-4d3a-448d-8d28-3642edae9973]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52bece4-3072-4a68-a081-7008aa403ae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f474ee-35e7-4147-b9e8-00ef786677f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:42:07 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:42:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47806a93-038a-40b2-a770-f800bdebf022]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updating existing volume attachment record: 1b66c008-647f-42cf-ae80-d7038f79d580 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:42:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Successfully created port: f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Successfully updated port: f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquired lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-changed-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Refreshing instance network info cache due to event network-changed-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] Acquiring lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:42:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updating instance_info_cache with network_info: [{"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Releasing lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Instance network_info: |[{"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] Acquired lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Refreshing network info cache for port f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updated VIF entry in instance network info cache for port f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updating instance_info_cache with network_info: [{"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-046b6377-dcd5-496f-adad-5aae7b3244fb req-370d6ef3-0edd-4695-b1dc-5e27dbdb9680 service nova] Releasing lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:42:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "bd444771-6b7d-4297-bfbe-86efe908b8fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:11 user nova-compute[75071]: INFO nova.compute.manager [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Terminating instance
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-792a8f6e-7db7-4f73-b7ad-e764f2edce5b req-c0cd3a53-4f66-42c8-9837-c1cbea97323f service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received event network-vif-unplugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-792a8f6e-7db7-4f73-b7ad-e764f2edce5b req-c0cd3a53-4f66-42c8-9837-c1cbea97323f service nova] Acquiring lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-792a8f6e-7db7-4f73-b7ad-e764f2edce5b req-c0cd3a53-4f66-42c8-9837-c1cbea97323f service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-792a8f6e-7db7-4f73-b7ad-e764f2edce5b req-c0cd3a53-4f66-42c8-9837-c1cbea97323f service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-792a8f6e-7db7-4f73-b7ad-e764f2edce5b req-c0cd3a53-4f66-42c8-9837-c1cbea97323f service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] No waiting events found dispatching network-vif-unplugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-792a8f6e-7db7-4f73-b7ad-e764f2edce5b req-c0cd3a53-4f66-42c8-9837-c1cbea97323f service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received event network-vif-unplugged-ad349d99-7b05-4681-a3bc-698826a3996a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:42:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Instance destroyed successfully.
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lazy-loading 'resources' on Instance uuid bd444771-6b7d-4297-bfbe-86efe908b8fc {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-717774254',display_name='tempest-VolumesActionsTest-instance-717774254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-717774254',id=42,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80aae2c977154745aec9e9463767dbbb',ramdisk_id='',reservation_id='r-3t5lc6ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1166636287',owner_user_name='tempest-VolumesActionsTest-1166636287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:40:28Z,user_data=None,user_id='fb5e9e2b5adc49de9355b7a80eb741d7',uuid=bd444771-6b7d-4297-bfbe-86efe908b8fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converting VIF {"id": "ad349d99-7b05-4681-a3bc-698826a3996a", "address": "fa:16:3e:43:50:c0", "network": {"id": "1f329678-3a1c-4993-a92b-f7cc27be54ed", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85281407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80aae2c977154745aec9e9463767dbbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad349d99-7b", "ovs_interfaceid": "ad349d99-7b05-4681-a3bc-698826a3996a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:50:c0,bridge_name='br-int',has_traffic_filtering=True,id=ad349d99-7b05-4681-a3bc-698826a3996a,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad349d99-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG os_vif [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:50:c0,bridge_name='br-int',has_traffic_filtering=True,id=ad349d99-7b05-4681-a3bc-698826a3996a,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad349d99-7b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad349d99-7b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ada4a92e-9c46-4efe-8880-be5ac77734de) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:11 user nova-compute[75071]: INFO os_vif [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:50:c0,bridge_name='br-int',has_traffic_filtering=True,id=ad349d99-7b05-4681-a3bc-698826a3996a,network=Network(1f329678-3a1c-4993-a92b-f7cc27be54ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad349d99-7b')
Nov 29 13:42:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Deleting instance files /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc_del
Nov 29 13:42:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Deletion of /opt/stack/data/nova/instances/bd444771-6b7d-4297-bfbe-86efe908b8fc_del complete
Nov 29 13:42:12 user nova-compute[75071]: INFO nova.compute.manager [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 13:42:12 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:42:12 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:42:12 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:42:12 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:12 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Took 0.73 seconds to deallocate network for instance.
Nov 29 13:42:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-7cbf17af-99de-410a-8f48-c01378b89013 req-d092aae8-9edf-4b0d-ad7b-73d8fbb37900 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received event network-vif-deleted-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:12 user nova-compute[75071]: INFO nova.compute.manager [req-7cbf17af-99de-410a-8f48-c01378b89013 req-d092aae8-9edf-4b0d-ad7b-73d8fbb37900 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Neutron deleted interface ad349d99-7b05-4681-a3bc-698826a3996a; detaching it from the instance and deleting it from the info cache
Nov 29 13:42:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-7cbf17af-99de-410a-8f48-c01378b89013 req-d092aae8-9edf-4b0d-ad7b-73d8fbb37900 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-7cbf17af-99de-410a-8f48-c01378b89013 req-d092aae8-9edf-4b0d-ad7b-73d8fbb37900 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Detach interface failed, port_id=ad349d99-7b05-4681-a3bc-698826a3996a, reason: Instance bd444771-6b7d-4297-bfbe-86efe908b8fc could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:42:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:13 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Deleted allocations for instance bd444771-6b7d-4297-bfbe-86efe908b8fc
Nov 29 13:42:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ab785948-0bfa-4056-b42f-b3b64355c16f tempest-VolumesActionsTest-1166636287 tempest-VolumesActionsTest-1166636287-project-member] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.036s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-a732708e-3ac4-4fc7-92c1-a5480e45ba97 req-bececaa5-29e2-4b6c-84f1-01a57f1cae13 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received event network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a732708e-3ac4-4fc7-92c1-a5480e45ba97 req-bececaa5-29e2-4b6c-84f1-01a57f1cae13 service nova] Acquiring lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a732708e-3ac4-4fc7-92c1-a5480e45ba97 req-bececaa5-29e2-4b6c-84f1-01a57f1cae13 service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a732708e-3ac4-4fc7-92c1-a5480e45ba97 req-bececaa5-29e2-4b6c-84f1-01a57f1cae13 service nova] Lock "bd444771-6b7d-4297-bfbe-86efe908b8fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-a732708e-3ac4-4fc7-92c1-a5480e45ba97 req-bececaa5-29e2-4b6c-84f1-01a57f1cae13 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] No waiting events found dispatching network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:13 user nova-compute[75071]: WARNING nova.compute.manager [req-a732708e-3ac4-4fc7-92c1-a5480e45ba97 req-bececaa5-29e2-4b6c-84f1-01a57f1cae13 service nova] [instance: bd444771-6b7d-4297-bfbe-86efe908b8fc] Received unexpected event network-vif-plugged-ad349d99-7b05-4681-a3bc-698826a3996a for instance with vm_state deleted and task_state None.
Nov 29 13:42:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:42:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Creating image(s)
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Ensure instance console log exists: /opt/stack/data/nova/instances/1b7510aa-f55b-48bf-8d7a-6807dab59057/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Start _get_guest_xml network_info=[{"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnabEOZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b7510aa-f55b-48bf-8d7a-6807dab59057', 'attached_at': '', 'detached_at': '', 'volume_id': '798f58ef-e03d-453c-89dd-89a35c315d3f', 'serial': '798f58ef-e03d-453c-89dd-89a35c315d3f'}, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1b66c008-647f-42cf-ae80-d7038f79d580', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:42:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:42:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnabEOZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:42:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:42:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:42:15 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3367ac-12f4-4d29-885b-88eac666a011]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:42:15 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb607ec3-6b38-430f-afe8-5f4691d08648]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f] added
Nov 29 13:42:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4b760e-1e65-4f89-94c4-a21f2369803d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4534353f-3bd0-47bf-a92f-f2163e877876]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnabEOZB {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnabEOZB" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b768d-531e-4f60-99ae-dcd57646f512]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JnabEOZB'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8f218-eef1-4dcd-b2f0-440e40aecc4e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[914b58b1-11fe-4012-9484-24d28d3bf4bc]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:42:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:42:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4743b7d3-8f18-4bcb-8ab6-613089463870]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260]
Nov 29 13:42:15 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260] successful.
Nov 29 13:42:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ae6752-c7c4-480d-bea7-6c9eb17460e5]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2368fdcc-b3d7-4a3a-8761-392179d51d9b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:42:15 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f (non-flash)
Nov 29 13:42:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:42:15 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f (non-flash)
Nov 29 13:42:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1cf54a-9a34-4685-b28c-757b6510afc4]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:42:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnabEOZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23662643663326265', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662643663326265', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-485769476',display_name='tempest-TestVolumeBootPattern-server-485769476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-485769476',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-i3w2fqib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:42:07Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=1b7510aa-f55b-48bf-8d7a-6807dab59057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:74:f6,bridge_name='br-int',has_traffic_filtering=True,id=f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ec9f2a-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b7510aa-f55b-48bf-8d7a-6807dab59057 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:42:16 user nova-compute[75071]:   <uuid>1b7510aa-f55b-48bf-8d7a-6807dab59057</uuid>
Nov 29 13:42:16 user nova-compute[75071]:   <name>instance-0000002c</name>
Nov 29 13:42:16 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:42:16 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:42:16 user nova-compute[75071]:   <metadata>
Nov 29 13:42:16 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:42:16 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:42:16 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-485769476</nova:name>
Nov 29 13:42:16 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:42:15</nova:creationTime>
Nov 29 13:42:16 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:42:16 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:42:16 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:42:16 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:42:16 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:42:16 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:42:16 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:42:16 user nova-compute[75071]:       <nova:owner>
Nov 29 13:42:16 user nova-compute[75071]:         <nova:user uuid="32b037a2bbef4090a2317bfeedd8e155">tempest-TestVolumeBootPattern-2055293783-project-member</nova:user>
Nov 29 13:42:16 user nova-compute[75071]:         <nova:project uuid="86b75ecae6764ce1801dbab6253ac6c4">tempest-TestVolumeBootPattern-2055293783</nova:project>
Nov 29 13:42:16 user nova-compute[75071]:       </nova:owner>
Nov 29 13:42:16 user nova-compute[75071]:       <nova:ports>
Nov 29 13:42:16 user nova-compute[75071]:         <nova:port uuid="f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e">
Nov 29 13:42:16 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:42:16 user nova-compute[75071]:         </nova:port>
Nov 29 13:42:16 user nova-compute[75071]:       </nova:ports>
Nov 29 13:42:16 user nova-compute[75071]:     </nova:instance>
Nov 29 13:42:16 user nova-compute[75071]:   </metadata>
Nov 29 13:42:16 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:42:16 user nova-compute[75071]:     <system>
Nov 29 13:42:16 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:42:16 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:42:16 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:42:16 user nova-compute[75071]:       <entry name="serial">1b7510aa-f55b-48bf-8d7a-6807dab59057</entry>
Nov 29 13:42:16 user nova-compute[75071]:       <entry name="uuid">1b7510aa-f55b-48bf-8d7a-6807dab59057</entry>
Nov 29 13:42:16 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:42:16 user nova-compute[75071]:     </system>
Nov 29 13:42:16 user nova-compute[75071]:   </sysinfo>
Nov 29 13:42:16 user nova-compute[75071]:   <os>
Nov 29 13:42:16 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:42:16 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:42:16 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:42:16 user nova-compute[75071]:   </os>
Nov 29 13:42:16 user nova-compute[75071]:   <features>
Nov 29 13:42:16 user nova-compute[75071]:     <acpi/>
Nov 29 13:42:16 user nova-compute[75071]:     <apic/>
Nov 29 13:42:16 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:42:16 user nova-compute[75071]:   </features>
Nov 29 13:42:16 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:42:16 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:42:16 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:42:16 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:42:16 user nova-compute[75071]:   </clock>
Nov 29 13:42:16 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:42:16 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:42:16 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:42:16 user nova-compute[75071]:   </cpu>
Nov 29 13:42:16 user nova-compute[75071]:   <devices>
Nov 29 13:42:16 user nova-compute[75071]:     <disk type="block" device="disk">
Nov 29 13:42:16 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:42:16 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Nov 29 13:42:16 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:42:16 user nova-compute[75071]:       <serial>798f58ef-e03d-453c-89dd-89a35c315d3f</serial>
Nov 29 13:42:16 user nova-compute[75071]:     </disk>
Nov 29 13:42:16 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:42:16 user nova-compute[75071]:       <mac address="fa:16:3e:1d:74:f6"/>
Nov 29 13:42:16 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:42:16 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:42:16 user nova-compute[75071]:       <target dev="tapf1ec9f2a-89"/>
Nov 29 13:42:16 user nova-compute[75071]:     </interface>
Nov 29 13:42:16 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:42:16 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/1b7510aa-f55b-48bf-8d7a-6807dab59057/console.log" append="off"/>
Nov 29 13:42:16 user nova-compute[75071]:     </serial>
Nov 29 13:42:16 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:42:16 user nova-compute[75071]:     <video>
Nov 29 13:42:16 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:42:16 user nova-compute[75071]:     </video>
Nov 29 13:42:16 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:42:16 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:42:16 user nova-compute[75071]:     </rng>
Nov 29 13:42:16 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:42:16 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:42:16 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:42:16 user nova-compute[75071]:     </memballoon>
Nov 29 13:42:16 user nova-compute[75071]:   </devices>
Nov 29 13:42:16 user nova-compute[75071]: </domain>
Nov 29 13:42:16 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-485769476',display_name='tempest-TestVolumeBootPattern-server-485769476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-485769476',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-i3w2fqib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:42:07Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=1b7510aa-f55b-48bf-8d7a-6807dab59057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:74:f6,bridge_name='br-int',has_traffic_filtering=True,id=f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ec9f2a-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG os_vif [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:74:f6,bridge_name='br-int',has_traffic_filtering=True,id=f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ec9f2a-89') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8de21efc-08f0-55d0-8727-d5b28666d240', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1ec9f2a-89, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1ec9f2a-89, col_values=(('qos', UUID('7f667c45-084d-4387-99fe-06423b1c4724')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1ec9f2a-89, col_values=(('external_ids', {'iface-id': 'f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:74:f6', 'vm-uuid': '1b7510aa-f55b-48bf-8d7a-6807dab59057'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:16 user nova-compute[75071]: INFO os_vif [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:74:f6,bridge_name='br-int',has_traffic_filtering=True,id=f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ec9f2a-89')
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:42:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] No VIF found with MAC fa:16:3e:1d:74:f6, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:42:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-02f20c7c-80e2-4b42-b436-f351457e0370 req-8f18949e-911f-492f-9ebc-a50a908ccf3e service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-02f20c7c-80e2-4b42-b436-f351457e0370 req-8f18949e-911f-492f-9ebc-a50a908ccf3e service nova] Acquiring lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-02f20c7c-80e2-4b42-b436-f351457e0370 req-8f18949e-911f-492f-9ebc-a50a908ccf3e service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-02f20c7c-80e2-4b42-b436-f351457e0370 req-8f18949e-911f-492f-9ebc-a50a908ccf3e service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-02f20c7c-80e2-4b42-b436-f351457e0370 req-8f18949e-911f-492f-9ebc-a50a908ccf3e service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] No waiting events found dispatching network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:18 user nova-compute[75071]: WARNING nova.compute.manager [req-02f20c7c-80e2-4b42-b436-f351457e0370 req-8f18949e-911f-492f-9ebc-a50a908ccf3e service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received unexpected event network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e for instance with vm_state building and task_state spawning.
Nov 29 13:42:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:42:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Instance spawned successfully.
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:42:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:42:20 user nova-compute[75071]: INFO nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 29 13:42:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:42:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-3f76a7cc-0ab1-497c-8b0c-5122eb63e902 req-7eb67f4b-00ab-419c-880c-7b34bebf1c86 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3f76a7cc-0ab1-497c-8b0c-5122eb63e902 req-7eb67f4b-00ab-419c-880c-7b34bebf1c86 service nova] Acquiring lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3f76a7cc-0ab1-497c-8b0c-5122eb63e902 req-7eb67f4b-00ab-419c-880c-7b34bebf1c86 service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3f76a7cc-0ab1-497c-8b0c-5122eb63e902 req-7eb67f4b-00ab-419c-880c-7b34bebf1c86 service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-3f76a7cc-0ab1-497c-8b0c-5122eb63e902 req-7eb67f4b-00ab-419c-880c-7b34bebf1c86 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] No waiting events found dispatching network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:20 user nova-compute[75071]: WARNING nova.compute.manager [req-3f76a7cc-0ab1-497c-8b0c-5122eb63e902 req-7eb67f4b-00ab-419c-880c-7b34bebf1c86 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received unexpected event network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e for instance with vm_state building and task_state spawning.
Nov 29 13:42:20 user nova-compute[75071]: INFO nova.compute.manager [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Took 13.46 seconds to build instance.
Nov 29 13:42:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2097e889-7b28-4319-bba2-1086aade19e9 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.557s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:42:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:42:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:42:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:32 user nova-compute[75071]: INFO nova.compute.manager [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Terminating instance
Nov 29 13:42:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-1fdc5234-1176-42c1-a05a-a3973ea6b3b6 req-7c574382-e3da-4ff0-9aee-81ce97293b02 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received event network-vif-unplugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1fdc5234-1176-42c1-a05a-a3973ea6b3b6 req-7c574382-e3da-4ff0-9aee-81ce97293b02 service nova] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1fdc5234-1176-42c1-a05a-a3973ea6b3b6 req-7c574382-e3da-4ff0-9aee-81ce97293b02 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1fdc5234-1176-42c1-a05a-a3973ea6b3b6 req-7c574382-e3da-4ff0-9aee-81ce97293b02 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-1fdc5234-1176-42c1-a05a-a3973ea6b3b6 req-7c574382-e3da-4ff0-9aee-81ce97293b02 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] No waiting events found dispatching network-vif-unplugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-1fdc5234-1176-42c1-a05a-a3973ea6b3b6 req-7c574382-e3da-4ff0-9aee-81ce97293b02 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received event network-vif-unplugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Instance destroyed successfully.
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lazy-loading 'resources' on Instance uuid a0bdb312-835a-499a-af02-58f5f25f50e9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:22:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2119767777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2119767777',id=16,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:23:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecd1e8292884439b8d49dd698bf812e1',ramdisk_id='',reservation_id='r-tlh6esp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-398011867',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:24:52Z,user_data=None,user_id='f902428dcca045ffa81dbd8fd53048b6',uuid=a0bdb312-835a-499a-af02-58f5f25f50e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converting VIF {"id": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "address": "fa:16:3e:59:82:e0", "network": {"id": "543f34eb-cbb9-4051-8df6-a05a2f923843", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1234153579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecd1e8292884439b8d49dd698bf812e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cc9c18-c7", "ovs_interfaceid": "c0cc9c18-c776-4177-b726-c19ac5dd2284", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:82:e0,bridge_name='br-int',has_traffic_filtering=True,id=c0cc9c18-c776-4177-b726-c19ac5dd2284,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cc9c18-c7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG os_vif [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:82:e0,bridge_name='br-int',has_traffic_filtering=True,id=c0cc9c18-c776-4177-b726-c19ac5dd2284,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cc9c18-c7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0cc9c18-c7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3e9d16a-b3aa-4b5b-8c6e-3bc23430ccd8) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:33 user nova-compute[75071]: INFO os_vif [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:82:e0,bridge_name='br-int',has_traffic_filtering=True,id=c0cc9c18-c776-4177-b726-c19ac5dd2284,network=Network(543f34eb-cbb9-4051-8df6-a05a2f923843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cc9c18-c7')
Nov 29 13:42:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Deleting instance files /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9_del
Nov 29 13:42:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Deletion of /opt/stack/data/nova/instances/a0bdb312-835a-499a-af02-58f5f25f50e9_del complete
Nov 29 13:42:33 user nova-compute[75071]: INFO nova.compute.manager [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 13:42:33 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:42:33 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:42:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:34 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:34 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Took 0.47 seconds to deallocate network for instance.
Nov 29 13:42:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-f4f4c0b9-ae95-40d9-add5-5108b8606adf req-8a6e28c7-a8af-4ff5-9f30-5387fc1bc4d9 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received event network-vif-deleted-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:34 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:42:34 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:42:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:34 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Deleted allocations for instance a0bdb312-835a-499a-af02-58f5f25f50e9
Nov 29 13:42:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c1956583-29be-4a56-acde-0d31f180308a tempest-ServerBootFromVolumeStableRescueTest-398011867 tempest-ServerBootFromVolumeStableRescueTest-398011867-project-member] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-f7f9f742-67ab-4535-b898-5c565ea17660 req-f6467b3a-5e0d-4344-a5af-541bc41df529 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received event network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f7f9f742-67ab-4535-b898-5c565ea17660 req-f6467b3a-5e0d-4344-a5af-541bc41df529 service nova] Acquiring lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f7f9f742-67ab-4535-b898-5c565ea17660 req-f6467b3a-5e0d-4344-a5af-541bc41df529 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f7f9f742-67ab-4535-b898-5c565ea17660 req-f6467b3a-5e0d-4344-a5af-541bc41df529 service nova] Lock "a0bdb312-835a-499a-af02-58f5f25f50e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-f7f9f742-67ab-4535-b898-5c565ea17660 req-f6467b3a-5e0d-4344-a5af-541bc41df529 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] No waiting events found dispatching network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:35 user nova-compute[75071]: WARNING nova.compute.manager [req-f7f9f742-67ab-4535-b898-5c565ea17660 req-f6467b3a-5e0d-4344-a5af-541bc41df529 service nova] [instance: a0bdb312-835a-499a-af02-58f5f25f50e9] Received unexpected event network-vif-plugged-c0cc9c18-c776-4177-b726-c19ac5dd2284 for instance with vm_state deleted and task_state None.
Nov 29 13:42:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:43 user nova-compute[75071]: INFO nova.compute.manager [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Rescuing
Nov 29 13:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-f4f23ad0-b88c-48b0-8f86-faffa81b4c69 req-b23e01f5-62dc-468f-9858-db8441cc2f47 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f4f23ad0-b88c-48b0-8f86-faffa81b4c69 req-b23e01f5-62dc-468f-9858-db8441cc2f47 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f4f23ad0-b88c-48b0-8f86-faffa81b4c69 req-b23e01f5-62dc-468f-9858-db8441cc2f47 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f4f23ad0-b88c-48b0-8f86-faffa81b4c69 req-b23e01f5-62dc-468f-9858-db8441cc2f47 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-f4f23ad0-b88c-48b0-8f86-faffa81b4c69 req-b23e01f5-62dc-468f-9858-db8441cc2f47 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:43 user nova-compute[75071]: WARNING nova.compute.manager [req-f4f23ad0-b88c-48b0-8f86-faffa81b4c69 req-b23e01f5-62dc-468f-9858-db8441cc2f47 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state active and task_state rescuing.
Nov 29 13:42:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance destroyed successfully.
Nov 29 13:42:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Attempting rescue
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:42:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Creating image(s)
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue" returned: 0 in 0.048s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'migration_context' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.base [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Start _get_guest_xml network_info=[{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:6d:d0:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '794347ff-8cf3-49d9-8652-9f89337799af', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'resources' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.base [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.base [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:42:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:42:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.base [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2062987681',display_name='tempest-ServerRescueNegativeTestJSON-server-2062987681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2062987681',id=38,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-oj39li58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:38:07Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:6d:d0:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:6d:d0:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.objects.base [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:42:44 user nova-compute[75071]:   <uuid>7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce</uuid>
Nov 29 13:42:44 user nova-compute[75071]:   <name>instance-00000026</name>
Nov 29 13:42:44 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:42:44 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:42:44 user nova-compute[75071]:   <metadata>
Nov 29 13:42:44 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:42:44 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:42:44 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2062987681</nova:name>
Nov 29 13:42:44 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:42:44</nova:creationTime>
Nov 29 13:42:44 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:42:44 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:42:44 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:42:44 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:42:44 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:42:44 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:42:44 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:42:44 user nova-compute[75071]:       <nova:owner>
Nov 29 13:42:44 user nova-compute[75071]:         <nova:user uuid="2457f7d6a4f64d2d94a542d73403814f">tempest-ServerRescueNegativeTestJSON-904604817-project-member</nova:user>
Nov 29 13:42:44 user nova-compute[75071]:         <nova:project uuid="02fdf8ccfd7b4320b9422fd1145705cb">tempest-ServerRescueNegativeTestJSON-904604817</nova:project>
Nov 29 13:42:44 user nova-compute[75071]:       </nova:owner>
Nov 29 13:42:44 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:42:44 user nova-compute[75071]:       <nova:ports>
Nov 29 13:42:44 user nova-compute[75071]:         <nova:port uuid="251cf287-d635-477f-bc23-f0d8e8f1483d">
Nov 29 13:42:44 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:42:44 user nova-compute[75071]:         </nova:port>
Nov 29 13:42:44 user nova-compute[75071]:       </nova:ports>
Nov 29 13:42:44 user nova-compute[75071]:     </nova:instance>
Nov 29 13:42:44 user nova-compute[75071]:   </metadata>
Nov 29 13:42:44 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:42:44 user nova-compute[75071]:     <system>
Nov 29 13:42:44 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:42:44 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:42:44 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:42:44 user nova-compute[75071]:       <entry name="serial">7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce</entry>
Nov 29 13:42:44 user nova-compute[75071]:       <entry name="uuid">7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce</entry>
Nov 29 13:42:44 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:42:44 user nova-compute[75071]:     </system>
Nov 29 13:42:44 user nova-compute[75071]:   </sysinfo>
Nov 29 13:42:44 user nova-compute[75071]:   <os>
Nov 29 13:42:44 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:42:44 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:42:44 user nova-compute[75071]:   </os>
Nov 29 13:42:44 user nova-compute[75071]:   <features>
Nov 29 13:42:44 user nova-compute[75071]:     <acpi/>
Nov 29 13:42:44 user nova-compute[75071]:     <apic/>
Nov 29 13:42:44 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:42:44 user nova-compute[75071]:   </features>
Nov 29 13:42:44 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:42:44 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:42:44 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:42:44 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:42:44 user nova-compute[75071]:   </clock>
Nov 29 13:42:44 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:42:44 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:42:44 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:42:44 user nova-compute[75071]:   </cpu>
Nov 29 13:42:44 user nova-compute[75071]:   <devices>
Nov 29 13:42:44 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:42:44 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:42:44 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue"/>
Nov 29 13:42:44 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:42:44 user nova-compute[75071]:     </disk>
Nov 29 13:42:44 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:42:44 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:42:44 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk"/>
Nov 29 13:42:44 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:42:44 user nova-compute[75071]:     </disk>
Nov 29 13:42:44 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:42:44 user nova-compute[75071]:       <mac address="fa:16:3e:6d:d0:f9"/>
Nov 29 13:42:44 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:42:44 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:42:44 user nova-compute[75071]:       <target dev="tap251cf287-d6"/>
Nov 29 13:42:44 user nova-compute[75071]:     </interface>
Nov 29 13:42:44 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:42:44 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/console.log" append="off"/>
Nov 29 13:42:44 user nova-compute[75071]:     </serial>
Nov 29 13:42:44 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:42:44 user nova-compute[75071]:     <video>
Nov 29 13:42:44 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:42:44 user nova-compute[75071]:     </video>
Nov 29 13:42:44 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:42:44 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:42:44 user nova-compute[75071]:     </rng>
Nov 29 13:42:44 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:42:44 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:42:44 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:42:44 user nova-compute[75071]:     </memballoon>
Nov 29 13:42:44 user nova-compute[75071]:   </devices>
Nov 29 13:42:44 user nova-compute[75071]: </domain>
Nov 29 13:42:44 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:42:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance destroyed successfully.
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No VIF found with MAC fa:16:3e:6d:d0:f9, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:42:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-bfdaf46b-4cd0-4571-9436-811622bdeae6 req-c8bf85a7-f64c-4a37-8e2f-235b0f4f5491 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bfdaf46b-4cd0-4571-9436-811622bdeae6 req-c8bf85a7-f64c-4a37-8e2f-235b0f4f5491 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bfdaf46b-4cd0-4571-9436-811622bdeae6 req-c8bf85a7-f64c-4a37-8e2f-235b0f4f5491 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bfdaf46b-4cd0-4571-9436-811622bdeae6 req-c8bf85a7-f64c-4a37-8e2f-235b0f4f5491 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-bfdaf46b-4cd0-4571-9436-811622bdeae6 req-c8bf85a7-f64c-4a37-8e2f-235b0f4f5491 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:45 user nova-compute[75071]: WARNING nova.compute.manager [req-bfdaf46b-4cd0-4571-9436-811622bdeae6 req-c8bf85a7-f64c-4a37-8e2f-235b0f4f5491 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state active and task_state rescuing.
Nov 29 13:42:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:48 user nova-compute[75071]: WARNING nova.compute.manager [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state active and task_state rescuing.
Nov 29 13:42:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:48 user nova-compute[75071]: WARNING nova.compute.manager [req-64fcdcf9-dec5-471d-be46-e8ad694cadf0 req-96511b2c-e203-4e97-a9bd-fa2fbca120eb service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state active and task_state rescuing.
Nov 29 13:42:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8b0f81cc-4571-4eff-8c5f-e0171f5642d6 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:42:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:51 user nova-compute[75071]: INFO nova.compute.manager [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Terminating instance
Nov 29 13:42:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1bb4d2e-9fdb-46a1-a7ae-f1bf66ab909d req-5d12abd5-3327-464e-acaa-fdebecd5df60 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received event network-vif-unplugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1bb4d2e-9fdb-46a1-a7ae-f1bf66ab909d req-5d12abd5-3327-464e-acaa-fdebecd5df60 service nova] Acquiring lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1bb4d2e-9fdb-46a1-a7ae-f1bf66ab909d req-5d12abd5-3327-464e-acaa-fdebecd5df60 service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1bb4d2e-9fdb-46a1-a7ae-f1bf66ab909d req-5d12abd5-3327-464e-acaa-fdebecd5df60 service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1bb4d2e-9fdb-46a1-a7ae-f1bf66ab909d req-5d12abd5-3327-464e-acaa-fdebecd5df60 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] No waiting events found dispatching network-vif-unplugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1bb4d2e-9fdb-46a1-a7ae-f1bf66ab909d req-5d12abd5-3327-464e-acaa-fdebecd5df60 service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received event network-vif-unplugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:42:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Instance destroyed successfully.
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lazy-loading 'resources' on Instance uuid 527ab85b-ccbf-42a4-94c8-fb35cb9b058f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:41:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1793513750',display_name='tempest-VolumesNegativeTest-instance-1793513750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1793513750',id=43,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5a39e332f274492869c06dc515bcbb0',ramdisk_id='',reservation_id='r-hxmdxomx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1864574974',owner_user_name='tempest-VolumesNegativeTest-1864574974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:41:08Z,user_data=None,user_id='954c5e550bad4513baae53999a84f7d3',uuid=527ab85b-ccbf-42a4-94c8-fb35cb9b058f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Converting VIF {"id": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "address": "fa:16:3e:4d:e9:83", "network": {"id": "4e464a29-054c-4b44-8fa1-cc6e3e1cd42f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d2a2352f6278404fb75ba04f146b00d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fdc2125-b4", "ovs_interfaceid": "5fdc2125-b4aa-41d2-92ca-45063018eb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e9:83,bridge_name='br-int',has_traffic_filtering=True,id=5fdc2125-b4aa-41d2-92ca-45063018eb97,network=Network(4e464a29-054c-4b44-8fa1-cc6e3e1cd42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdc2125-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG os_vif [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e9:83,bridge_name='br-int',has_traffic_filtering=True,id=5fdc2125-b4aa-41d2-92ca-45063018eb97,network=Network(4e464a29-054c-4b44-8fa1-cc6e3e1cd42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdc2125-b4') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fdc2125-b4, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d238ed7d-faa3-47d3-a888-25c7e04b55d0) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:52 user nova-compute[75071]: INFO os_vif [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e9:83,bridge_name='br-int',has_traffic_filtering=True,id=5fdc2125-b4aa-41d2-92ca-45063018eb97,network=Network(4e464a29-054c-4b44-8fa1-cc6e3e1cd42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fdc2125-b4')
Nov 29 13:42:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Deleting instance files /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f_del
Nov 29 13:42:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Deletion of /opt/stack/data/nova/instances/527ab85b-ccbf-42a4-94c8-fb35cb9b058f_del complete
Nov 29 13:42:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:52 user nova-compute[75071]: INFO nova.compute.manager [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 13:42:52 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:52 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Took 0.51 seconds to deallocate network for instance.
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-4fdfd16f-0de6-4635-bffb-14192c8dc5e1 req-fab05ec2-4d1a-480f-94ec-1641c42897cd service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received event network-vif-deleted-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:52 user nova-compute[75071]: INFO nova.compute.manager [req-4fdfd16f-0de6-4635-bffb-14192c8dc5e1 req-fab05ec2-4d1a-480f-94ec-1641c42897cd service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Neutron deleted interface 5fdc2125-b4aa-41d2-92ca-45063018eb97; detaching it from the instance and deleting it from the info cache
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-4fdfd16f-0de6-4635-bffb-14192c8dc5e1 req-fab05ec2-4d1a-480f-94ec-1641c42897cd service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-4fdfd16f-0de6-4635-bffb-14192c8dc5e1 req-fab05ec2-4d1a-480f-94ec-1641c42897cd service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Detach interface failed, port_id=5fdc2125-b4aa-41d2-92ca-45063018eb97, reason: Instance 527ab85b-ccbf-42a4-94c8-fb35cb9b058f could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:42:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:53 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Deleted allocations for instance 527ab85b-ccbf-42a4-94c8-fb35cb9b058f
Nov 29 13:42:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-676efc79-8b75-4d5c-bb71-c89715977c63 tempest-VolumesNegativeTest-1864574974 tempest-VolumesNegativeTest-1864574974-project-member] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.856s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-815837eb-b22b-425a-b2e6-3c50ad0a5645 req-830af931-d5cb-48bc-825c-86c22243b2fd service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received event network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:42:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-815837eb-b22b-425a-b2e6-3c50ad0a5645 req-830af931-d5cb-48bc-825c-86c22243b2fd service nova] Acquiring lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:42:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-815837eb-b22b-425a-b2e6-3c50ad0a5645 req-830af931-d5cb-48bc-825c-86c22243b2fd service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:42:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-815837eb-b22b-425a-b2e6-3c50ad0a5645 req-830af931-d5cb-48bc-825c-86c22243b2fd service nova] Lock "527ab85b-ccbf-42a4-94c8-fb35cb9b058f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:42:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-815837eb-b22b-425a-b2e6-3c50ad0a5645 req-830af931-d5cb-48bc-825c-86c22243b2fd service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] No waiting events found dispatching network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:42:53 user nova-compute[75071]: WARNING nova.compute.manager [req-815837eb-b22b-425a-b2e6-3c50ad0a5645 req-830af931-d5cb-48bc-825c-86c22243b2fd service nova] [instance: 527ab85b-ccbf-42a4-94c8-fb35cb9b058f] Received unexpected event network-vif-plugged-5fdc2125-b4aa-41d2-92ca-45063018eb97 for instance with vm_state deleted and task_state None.
Nov 29 13:42:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:42:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:42:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:42:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:43:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:43:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.081722259521484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 1b7510aa-f55b-48bf-8d7a-6807dab59057 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:43:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:43:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:43:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:43:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:43:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:43:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:43:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:43:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:43:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-changed-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:43:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Refreshing instance network info cache due to event network-changed-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:43:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] Acquiring lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:43:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] Acquired lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:43:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Refreshing network info cache for port f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:43:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:43:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updated VIF entry in instance network info cache for port f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:43:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updating instance_info_cache with network_info: [{"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:43:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-221f5568-ae14-475b-8fa3-d975aa4a763a req-c54c1ed2-eee8-4c07-822c-0ec355dce964 service nova] Releasing lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:43:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:43:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-changed-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Refreshing instance network info cache due to event network-changed-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] Acquiring lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] Acquired lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Refreshing network info cache for port f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "1b7510aa-f55b-48bf-8d7a-6807dab59057" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:00 user nova-compute[75071]: INFO nova.compute.manager [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Terminating instance
Nov 29 13:44:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-a6b9dd82-f568-48ac-8d59-b1bf2022c16c req-9c4a1996-6419-4450-b591-ad94795c3e2a service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-vif-unplugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a6b9dd82-f568-48ac-8d59-b1bf2022c16c req-9c4a1996-6419-4450-b591-ad94795c3e2a service nova] Acquiring lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a6b9dd82-f568-48ac-8d59-b1bf2022c16c req-9c4a1996-6419-4450-b591-ad94795c3e2a service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a6b9dd82-f568-48ac-8d59-b1bf2022c16c req-9c4a1996-6419-4450-b591-ad94795c3e2a service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-a6b9dd82-f568-48ac-8d59-b1bf2022c16c req-9c4a1996-6419-4450-b591-ad94795c3e2a service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] No waiting events found dispatching network-vif-unplugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-a6b9dd82-f568-48ac-8d59-b1bf2022c16c req-9c4a1996-6419-4450-b591-ad94795c3e2a service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-vif-unplugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updated VIF entry in instance network info cache for port f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updating instance_info_cache with network_info: [{"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-595853de-88f4-403e-9c30-91d6cb00cd46 req-fbc0c5d1-d337-462d-b4a5-73daab1e8021 service nova] Releasing lock "refresh_cache-1b7510aa-f55b-48bf-8d7a-6807dab59057" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:44:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Instance destroyed successfully.
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'resources' on Instance uuid 1b7510aa-f55b-48bf-8d7a-6807dab59057 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-485769476',display_name='tempest-TestVolumeBootPattern-server-485769476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-485769476',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:42:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-i3w2fqib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:42:20Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=1b7510aa-f55b-48bf-8d7a-6807dab59057,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "address": "fa:16:3e:1d:74:f6", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1ec9f2a-89", "ovs_interfaceid": "f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:74:f6,bridge_name='br-int',has_traffic_filtering=True,id=f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ec9f2a-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_vif [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:74:f6,bridge_name='br-int',has_traffic_filtering=True,id=f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ec9f2a-89') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1ec9f2a-89, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f667c45-084d-4387-99fe-06423b1c4724) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:01 user nova-compute[75071]: INFO os_vif [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:74:f6,bridge_name='br-int',has_traffic_filtering=True,id=f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1ec9f2a-89')
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnabEOZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:44:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a9f64-afc9-420a-90c5-e16d8cfc735a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:44:01 user nova-compute[75071]: No targets found.
Nov 29 13:44:01 user nova-compute[75071]: iSNS:
Nov 29 13:44:01 user nova-compute[75071]: No targets found.
Nov 29 13:44:01 user nova-compute[75071]: STATIC:
Nov 29 13:44:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135
Nov 29 13:44:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:44:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:44:01 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f
Nov 29 13:44:01 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:44:01 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:44:01 user nova-compute[75071]: FIRMWARE:
Nov 29 13:44:01 user nova-compute[75071]: No targets found.
Nov 29 13:44:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:44:01 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:44:01 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb755c3-5875-40c0-b757-64d108915df3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a287e0f5-3afc-45af-b192-ee925c9b180e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:44:01 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f (non-flash)
Nov 29 13:44:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:44:01 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f (non-flash)
Nov 29 13:44:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e19fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8e2c63-5b16-401c-8490-faa145afd6be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd18cd-b255-4b23-9b6e-06678c1deb7d]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cf144f-2fee-4386-94db-dc89749151dd]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade3a8c-1c9c-4f1a-94b1-9218afea15a2]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO23d73298-6bd6c2bee7a66fcb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_23d73298', '/dev/disk/by-id/scsi-23662643663326265') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07bb991-ddc6-436a-a395-f9a385fba196]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe6beb-194e-4b4f-bba2-4be0614c6a58]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0596ef7-0347-427f-9d46-aa37dc49e2e2]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260]
Nov 29 13:44:01 user nova-compute[75071]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f, portal: 172.16.0.220,3260] successful.
Nov 29 13:44:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798f58ef-e03d-453c-89dd-89a35c315d3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b96cbb-8a75-449b-b1dc-e5f3b7252c9f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== disconnect_volume: return (374ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:44:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:44:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Deleting instance files /opt/stack/data/nova/instances/1b7510aa-f55b-48bf-8d7a-6807dab59057_del
Nov 29 13:44:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Deletion of /opt/stack/data/nova/instances/1b7510aa-f55b-48bf-8d7a-6807dab59057_del complete
Nov 29 13:44:02 user nova-compute[75071]: INFO nova.compute.manager [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 29 13:44:02 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:44:02 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:44:02 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:44:02 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:02 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Took 0.60 seconds to deallocate network for instance.
Nov 29 13:44:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-15ffda46-f377-46b1-aa1a-18468ea37c84 req-6fd31594-972c-4ebb-8669-5aafa23e32a4 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15ffda46-f377-46b1-aa1a-18468ea37c84 req-6fd31594-972c-4ebb-8669-5aafa23e32a4 service nova] Acquiring lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15ffda46-f377-46b1-aa1a-18468ea37c84 req-6fd31594-972c-4ebb-8669-5aafa23e32a4 service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15ffda46-f377-46b1-aa1a-18468ea37c84 req-6fd31594-972c-4ebb-8669-5aafa23e32a4 service nova] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-15ffda46-f377-46b1-aa1a-18468ea37c84 req-6fd31594-972c-4ebb-8669-5aafa23e32a4 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] No waiting events found dispatching network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:03 user nova-compute[75071]: WARNING nova.compute.manager [req-15ffda46-f377-46b1-aa1a-18468ea37c84 req-6fd31594-972c-4ebb-8669-5aafa23e32a4 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received unexpected event network-vif-plugged-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e for instance with vm_state active and task_state deleting.
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-15ffda46-f377-46b1-aa1a-18468ea37c84 req-6fd31594-972c-4ebb-8669-5aafa23e32a4 service nova] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Received event network-vif-deleted-f1ec9f2a-89ad-4dc2-b77a-a27d48e0274e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating instance_info_cache with network_info: [{"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:03 user nova-compute[75071]: INFO nova.compute.manager [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: 1b7510aa-f55b-48bf-8d7a-6807dab59057] Took 0.90 seconds to detach 1 volumes for instance.
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:44:04 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:44:04 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:44:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:04 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Deleted allocations for instance 1b7510aa-f55b-48bf-8d7a-6807dab59057
Nov 29 13:44:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0b89aad3-e537-4cd6-a4b5-aafd84d4fca6 tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "1b7510aa-f55b-48bf-8d7a-6807dab59057" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.606s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:07 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:44:07 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.067733764648438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:44:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:44:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:44:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:44:29 user nova-compute[75071]: INFO nova.compute.claims [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Claim successful on node user
Nov 29 13:44:29 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:44:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:44:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.policy [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d3f4fb84c6f4856839c72b68614ce90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efc039a35ea4aecb0d420a1e2a7e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:44:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Creating image(s)
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "/opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "/opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "/opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk 1073741824" returned: 0 in 0.142s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Successfully created port: 1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Cannot resize image /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Ensure instance console log exists: /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Successfully updated port: 1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquired lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-changed-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Refreshing instance network info cache due to event network-changed-1663755f-d533-4eaa-b434-9da5aa615418. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] Acquiring lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:44:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Updating instance_info_cache with network_info: [{"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Releasing lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Instance network_info: |[{"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] Acquired lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Refreshing network info cache for port 1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Start _get_guest_xml network_info=[{"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:44:32 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:44:32 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1628909320',display_name='tempest-VolumesSnapshotTestJSON-instance-1628909320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1628909320',id=45,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxk56yqhT17nN7YerNpfZ8kQgyhcbN2YuA53S3CaI1uHVcIy7FXSm1Yrb9uzyi/2QF+3PL5jOVkGTyGsNbACfQLNiUE17G5San/GYYNlkQOWDbOKuVlQa8v0xrpsq9wCQ==',key_name='tempest-keypair-864825811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efc039a35ea4aecb0d420a1e2a7e2df',ramdisk_id='',reservation_id='r-8kiosr7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815296959',owner_user_name='tempest-VolumesSnapshotTestJSON-815296959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d3f4fb84c6f4856839c72b68614ce90',uuid=9837f8e4-6886-4340-87d5-ec13d45575cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converting VIF {"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=1663755f-d533-4eaa-b434-9da5aa615418,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663755f-d5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'pci_devices' on Instance uuid 9837f8e4-6886-4340-87d5-ec13d45575cf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:44:32 user nova-compute[75071]:   <uuid>9837f8e4-6886-4340-87d5-ec13d45575cf</uuid>
Nov 29 13:44:32 user nova-compute[75071]:   <name>instance-0000002d</name>
Nov 29 13:44:32 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:44:32 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:44:32 user nova-compute[75071]:   <metadata>
Nov 29 13:44:32 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:44:32 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:44:32 user nova-compute[75071]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1628909320</nova:name>
Nov 29 13:44:32 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:44:32</nova:creationTime>
Nov 29 13:44:32 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:44:32 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:44:32 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:44:32 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:44:32 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:44:32 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:44:32 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:44:32 user nova-compute[75071]:       <nova:owner>
Nov 29 13:44:32 user nova-compute[75071]:         <nova:user uuid="0d3f4fb84c6f4856839c72b68614ce90">tempest-VolumesSnapshotTestJSON-815296959-project-member</nova:user>
Nov 29 13:44:32 user nova-compute[75071]:         <nova:project uuid="5efc039a35ea4aecb0d420a1e2a7e2df">tempest-VolumesSnapshotTestJSON-815296959</nova:project>
Nov 29 13:44:32 user nova-compute[75071]:       </nova:owner>
Nov 29 13:44:32 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:44:32 user nova-compute[75071]:       <nova:ports>
Nov 29 13:44:32 user nova-compute[75071]:         <nova:port uuid="1663755f-d533-4eaa-b434-9da5aa615418">
Nov 29 13:44:32 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 13:44:32 user nova-compute[75071]:         </nova:port>
Nov 29 13:44:32 user nova-compute[75071]:       </nova:ports>
Nov 29 13:44:32 user nova-compute[75071]:     </nova:instance>
Nov 29 13:44:32 user nova-compute[75071]:   </metadata>
Nov 29 13:44:32 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:44:32 user nova-compute[75071]:     <system>
Nov 29 13:44:32 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:44:32 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:44:32 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:44:32 user nova-compute[75071]:       <entry name="serial">9837f8e4-6886-4340-87d5-ec13d45575cf</entry>
Nov 29 13:44:32 user nova-compute[75071]:       <entry name="uuid">9837f8e4-6886-4340-87d5-ec13d45575cf</entry>
Nov 29 13:44:32 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:44:32 user nova-compute[75071]:     </system>
Nov 29 13:44:32 user nova-compute[75071]:   </sysinfo>
Nov 29 13:44:32 user nova-compute[75071]:   <os>
Nov 29 13:44:32 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:44:32 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:44:32 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:44:32 user nova-compute[75071]:   </os>
Nov 29 13:44:32 user nova-compute[75071]:   <features>
Nov 29 13:44:32 user nova-compute[75071]:     <acpi/>
Nov 29 13:44:32 user nova-compute[75071]:     <apic/>
Nov 29 13:44:32 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:44:32 user nova-compute[75071]:   </features>
Nov 29 13:44:32 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:44:32 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:44:32 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:44:32 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:44:32 user nova-compute[75071]:   </clock>
Nov 29 13:44:32 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:44:32 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:44:32 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:44:32 user nova-compute[75071]:   </cpu>
Nov 29 13:44:32 user nova-compute[75071]:   <devices>
Nov 29 13:44:32 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:44:32 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:44:32 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk"/>
Nov 29 13:44:32 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:44:32 user nova-compute[75071]:     </disk>
Nov 29 13:44:32 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:44:32 user nova-compute[75071]:       <mac address="fa:16:3e:f2:46:f1"/>
Nov 29 13:44:32 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:44:32 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:44:32 user nova-compute[75071]:       <target dev="tap1663755f-d5"/>
Nov 29 13:44:32 user nova-compute[75071]:     </interface>
Nov 29 13:44:32 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:44:32 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/console.log" append="off"/>
Nov 29 13:44:32 user nova-compute[75071]:     </serial>
Nov 29 13:44:32 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:44:32 user nova-compute[75071]:     <video>
Nov 29 13:44:32 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:44:32 user nova-compute[75071]:     </video>
Nov 29 13:44:32 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:44:32 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:44:32 user nova-compute[75071]:     </rng>
Nov 29 13:44:32 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:44:32 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:44:32 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:44:32 user nova-compute[75071]:     </memballoon>
Nov 29 13:44:32 user nova-compute[75071]:   </devices>
Nov 29 13:44:32 user nova-compute[75071]: </domain>
Nov 29 13:44:32 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1628909320',display_name='tempest-VolumesSnapshotTestJSON-instance-1628909320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1628909320',id=45,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxk56yqhT17nN7YerNpfZ8kQgyhcbN2YuA53S3CaI1uHVcIy7FXSm1Yrb9uzyi/2QF+3PL5jOVkGTyGsNbACfQLNiUE17G5San/GYYNlkQOWDbOKuVlQa8v0xrpsq9wCQ==',key_name='tempest-keypair-864825811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efc039a35ea4aecb0d420a1e2a7e2df',ramdisk_id='',reservation_id='r-8kiosr7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815296959',owner_user_name='tempest-VolumesSnapshotTestJSON-815296959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d3f4fb84c6f4856839c72b68614ce90',uuid=9837f8e4-6886-4340-87d5-ec13d45575cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converting VIF {"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=1663755f-d533-4eaa-b434-9da5aa615418,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663755f-d5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG os_vif [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=1663755f-d533-4eaa-b434-9da5aa615418,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663755f-d5') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b667a81-1679-5a10-afdc-b6b350e6bb32', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1663755f-d5, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1663755f-d5, col_values=(('qos', UUID('08891bab-287c-4104-9439-7905ca5a5001')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1663755f-d5, col_values=(('external_ids', {'iface-id': '1663755f-d533-4eaa-b434-9da5aa615418', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:46:f1', 'vm-uuid': '9837f8e4-6886-4340-87d5-ec13d45575cf'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:32 user nova-compute[75071]: INFO os_vif [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=1663755f-d533-4eaa-b434-9da5aa615418,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663755f-d5')
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No VIF found with MAC fa:16:3e:f2:46:f1, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Updated VIF entry in instance network info cache for port 1663755f-d533-4eaa-b434-9da5aa615418. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Updating instance_info_cache with network_info: [{"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-16a9dd6e-0c01-4d11-92bc-a33684298468 req-da699478-bdb4-4460-8fc0-dcc0ff7f37c8 service nova] Releasing lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:44:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-59de1b0b-759b-41a1-bb61-ac978cbb974a req-30f8cd7e-f6d0-42ab-9003-cb0317c03a1f service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-59de1b0b-759b-41a1-bb61-ac978cbb974a req-30f8cd7e-f6d0-42ab-9003-cb0317c03a1f service nova] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-59de1b0b-759b-41a1-bb61-ac978cbb974a req-30f8cd7e-f6d0-42ab-9003-cb0317c03a1f service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-59de1b0b-759b-41a1-bb61-ac978cbb974a req-30f8cd7e-f6d0-42ab-9003-cb0317c03a1f service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-59de1b0b-759b-41a1-bb61-ac978cbb974a req-30f8cd7e-f6d0-42ab-9003-cb0317c03a1f service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] No waiting events found dispatching network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:34 user nova-compute[75071]: WARNING nova.compute.manager [req-59de1b0b-759b-41a1-bb61-ac978cbb974a req-30f8cd7e-f6d0-42ab-9003-cb0317c03a1f service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received unexpected event network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 for instance with vm_state building and task_state spawning.
Nov 29 13:44:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:34 user nova-compute[75071]: INFO nova.compute.manager [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Unrescuing
Nov 29 13:44:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:44:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:44:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:44:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'flavor' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-a21c47b4-24bb-4859-a490-b7f05c2d2bae req-0cbb5c8e-0577-4137-a375-843c11f363c4 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a21c47b4-24bb-4859-a490-b7f05c2d2bae req-0cbb5c8e-0577-4137-a375-843c11f363c4 service nova] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a21c47b4-24bb-4859-a490-b7f05c2d2bae req-0cbb5c8e-0577-4137-a375-843c11f363c4 service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a21c47b4-24bb-4859-a490-b7f05c2d2bae req-0cbb5c8e-0577-4137-a375-843c11f363c4 service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-a21c47b4-24bb-4859-a490-b7f05c2d2bae req-0cbb5c8e-0577-4137-a375-843c11f363c4 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] No waiting events found dispatching network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:36 user nova-compute[75071]: WARNING nova.compute.manager [req-a21c47b4-24bb-4859-a490-b7f05c2d2bae req-0cbb5c8e-0577-4137-a375-843c11f363c4 service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received unexpected event network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 for instance with vm_state building and task_state spawning.
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:44:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Instance spawned successfully.
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:36 user nova-compute[75071]: INFO nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:44:36 user nova-compute[75071]: INFO nova.compute.manager [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Took 6.85 seconds to build instance.
Nov 29 13:44:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bdc53e0b-1cea-470b-b229-9a0fe185b5f5 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.980s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-40fdc43a-7f4e-4071-874c-0a912dd78c42 req-ad94e8ee-3151-4ee7-9810-405bfc2ce4a3 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-40fdc43a-7f4e-4071-874c-0a912dd78c42 req-ad94e8ee-3151-4ee7-9810-405bfc2ce4a3 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-40fdc43a-7f4e-4071-874c-0a912dd78c42 req-ad94e8ee-3151-4ee7-9810-405bfc2ce4a3 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-40fdc43a-7f4e-4071-874c-0a912dd78c42 req-ad94e8ee-3151-4ee7-9810-405bfc2ce4a3 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-40fdc43a-7f4e-4071-874c-0a912dd78c42 req-ad94e8ee-3151-4ee7-9810-405bfc2ce4a3 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:36 user nova-compute[75071]: WARNING nova.compute.manager [req-40fdc43a-7f4e-4071-874c-0a912dd78c42 req-ad94e8ee-3151-4ee7-9810-405bfc2ce4a3 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:44:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance destroyed successfully.
Nov 29 13:44:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:44:37 user nova-compute[75071]: INFO nova.compute.claims [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Claim successful on node user
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:44:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.policy [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddc6592629034ddeb9fe2fbfd607afed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f633d9dae01471ebf7006305703d7cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:44:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Creating image(s)
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "/opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "/opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.222s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.223s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk 1073741824" returned: 0 in 0.071s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Successfully created port: da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:38 user nova-compute[75071]: WARNING nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:38 user nova-compute[75071]: WARNING nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:38 user nova-compute[75071]: WARNING nova.compute.manager [req-6fa78152-d098-48b6-96aa-22cba6411ae1 req-d41a565b-08cf-4924-9410-fa462bce7ef1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.232s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Cannot resize image /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Ensure instance console log exists: /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Successfully updated port: da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquired lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-changed-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Refreshing instance network info cache due to event network-changed-da447ab2-b46a-47e1-9d7f-af5d637d95ab. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] Acquiring lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating instance_info_cache with network_info: [{"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Releasing lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Instance network_info: |[{"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] Acquired lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Refreshing network info cache for port da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Start _get_guest_xml network_info=[{"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:44:39 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:44:39 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1989015771',display_name='tempest-TestServerVolumeAttachmentScenario-server-1989015771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1989015771',id=46,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSd72QI9JuMhV2wcN2hBkV9ZtP1bJ9oSEwcGrcq8Sh5Q0ZAgBAf8Q69DiqUF9n4CTEHKFhNm9RkTiEoOKh44+ZhhVLJ/DSVroZPqp4P8qLLDPwQDG5sCWLT83Dzw4uI/w==',key_name='tempest-keypair-1747896639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f633d9dae01471ebf7006305703d7cd',ramdisk_id='',reservation_id='r-zvw49i97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-67934131',owner_user_name='tempest-TestServerVolumeAttachmentScenario-67934131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc6592629034ddeb9fe2fbfd607afed',uuid=e2b45485-babd-407e-9ec3-9898d2ba9d48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Converting VIF {"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cd:ad,bridge_name='br-int',has_traffic_filtering=True,id=da447ab2-b46a-47e1-9d7f-af5d637d95ab,network=Network(dbd635a5-84f5-42b1-ac93-fec02a9443bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda447ab2-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.objects.instance [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'pci_devices' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:44:39 user nova-compute[75071]:   <uuid>e2b45485-babd-407e-9ec3-9898d2ba9d48</uuid>
Nov 29 13:44:39 user nova-compute[75071]:   <name>instance-0000002e</name>
Nov 29 13:44:39 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:44:39 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:44:39 user nova-compute[75071]:   <metadata>
Nov 29 13:44:39 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:44:39 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:44:39 user nova-compute[75071]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1989015771</nova:name>
Nov 29 13:44:39 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:44:39</nova:creationTime>
Nov 29 13:44:39 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:44:39 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:44:39 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:44:39 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:44:39 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:44:39 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:44:39 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:44:39 user nova-compute[75071]:       <nova:owner>
Nov 29 13:44:39 user nova-compute[75071]:         <nova:user uuid="ddc6592629034ddeb9fe2fbfd607afed">tempest-TestServerVolumeAttachmentScenario-67934131-project-member</nova:user>
Nov 29 13:44:39 user nova-compute[75071]:         <nova:project uuid="5f633d9dae01471ebf7006305703d7cd">tempest-TestServerVolumeAttachmentScenario-67934131</nova:project>
Nov 29 13:44:39 user nova-compute[75071]:       </nova:owner>
Nov 29 13:44:39 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:44:39 user nova-compute[75071]:       <nova:ports>
Nov 29 13:44:39 user nova-compute[75071]:         <nova:port uuid="da447ab2-b46a-47e1-9d7f-af5d637d95ab">
Nov 29 13:44:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:44:39 user nova-compute[75071]:         </nova:port>
Nov 29 13:44:39 user nova-compute[75071]:       </nova:ports>
Nov 29 13:44:39 user nova-compute[75071]:     </nova:instance>
Nov 29 13:44:39 user nova-compute[75071]:   </metadata>
Nov 29 13:44:39 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:44:39 user nova-compute[75071]:     <system>
Nov 29 13:44:39 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:44:39 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:44:39 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:44:39 user nova-compute[75071]:       <entry name="serial">e2b45485-babd-407e-9ec3-9898d2ba9d48</entry>
Nov 29 13:44:39 user nova-compute[75071]:       <entry name="uuid">e2b45485-babd-407e-9ec3-9898d2ba9d48</entry>
Nov 29 13:44:39 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:44:39 user nova-compute[75071]:     </system>
Nov 29 13:44:39 user nova-compute[75071]:   </sysinfo>
Nov 29 13:44:39 user nova-compute[75071]:   <os>
Nov 29 13:44:39 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:44:39 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:44:39 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:44:39 user nova-compute[75071]:   </os>
Nov 29 13:44:39 user nova-compute[75071]:   <features>
Nov 29 13:44:39 user nova-compute[75071]:     <acpi/>
Nov 29 13:44:39 user nova-compute[75071]:     <apic/>
Nov 29 13:44:39 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:44:39 user nova-compute[75071]:   </features>
Nov 29 13:44:39 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:44:39 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:44:39 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:44:39 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:44:39 user nova-compute[75071]:   </clock>
Nov 29 13:44:39 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:44:39 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:44:39 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:44:39 user nova-compute[75071]:   </cpu>
Nov 29 13:44:39 user nova-compute[75071]:   <devices>
Nov 29 13:44:39 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:44:39 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:44:39 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk"/>
Nov 29 13:44:39 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:44:39 user nova-compute[75071]:     </disk>
Nov 29 13:44:39 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:44:39 user nova-compute[75071]:       <mac address="fa:16:3e:bd:cd:ad"/>
Nov 29 13:44:39 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:44:39 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:44:39 user nova-compute[75071]:       <target dev="tapda447ab2-b4"/>
Nov 29 13:44:39 user nova-compute[75071]:     </interface>
Nov 29 13:44:39 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:44:39 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/console.log" append="off"/>
Nov 29 13:44:39 user nova-compute[75071]:     </serial>
Nov 29 13:44:39 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:44:39 user nova-compute[75071]:     <video>
Nov 29 13:44:39 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:44:39 user nova-compute[75071]:     </video>
Nov 29 13:44:39 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:44:39 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:44:39 user nova-compute[75071]:     </rng>
Nov 29 13:44:39 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:44:39 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:44:39 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:44:39 user nova-compute[75071]:     </memballoon>
Nov 29 13:44:39 user nova-compute[75071]:   </devices>
Nov 29 13:44:39 user nova-compute[75071]: </domain>
Nov 29 13:44:39 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1989015771',display_name='tempest-TestServerVolumeAttachmentScenario-server-1989015771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1989015771',id=46,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSd72QI9JuMhV2wcN2hBkV9ZtP1bJ9oSEwcGrcq8Sh5Q0ZAgBAf8Q69DiqUF9n4CTEHKFhNm9RkTiEoOKh44+ZhhVLJ/DSVroZPqp4P8qLLDPwQDG5sCWLT83Dzw4uI/w==',key_name='tempest-keypair-1747896639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f633d9dae01471ebf7006305703d7cd',ramdisk_id='',reservation_id='r-zvw49i97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-67934131',owner_user_name='tempest-TestServerVolumeAttachmentScenario-67934131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc6592629034ddeb9fe2fbfd607afed',uuid=e2b45485-babd-407e-9ec3-9898d2ba9d48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Converting VIF {"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cd:ad,bridge_name='br-int',has_traffic_filtering=True,id=da447ab2-b46a-47e1-9d7f-af5d637d95ab,network=Network(dbd635a5-84f5-42b1-ac93-fec02a9443bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda447ab2-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG os_vif [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cd:ad,bridge_name='br-int',has_traffic_filtering=True,id=da447ab2-b46a-47e1-9d7f-af5d637d95ab,network=Network(dbd635a5-84f5-42b1-ac93-fec02a9443bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda447ab2-b4') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9429b991-6b79-5539-a437-42ff33c68f68', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda447ab2-b4, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda447ab2-b4, col_values=(('qos', UUID('c4285382-fedb-4c54-b1ec-c3fcad476735')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda447ab2-b4, col_values=(('external_ids', {'iface-id': 'da447ab2-b46a-47e1-9d7f-af5d637d95ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:cd:ad', 'vm-uuid': 'e2b45485-babd-407e-9ec3-9898d2ba9d48'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:44:39 user nova-compute[75071]: WARNING nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 9837f8e4-6886-4340-87d5-ec13d45575cf {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:39 user nova-compute[75071]: INFO nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:39 user nova-compute[75071]: INFO os_vif [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:cd:ad,bridge_name='br-int',has_traffic_filtering=True,id=da447ab2-b46a-47e1-9d7f-af5d637d95ab,network=Network(dbd635a5-84f5-42b1-ac93-fec02a9443bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda447ab2-b4')
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:44:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No VIF found with MAC fa:16:3e:bd:cd:ad, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:44:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updated VIF entry in instance network info cache for port da447ab2-b46a-47e1-9d7f-af5d637d95ab. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:44:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating instance_info_cache with network_info: [{"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:44:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a04e253-20b9-4776-978f-9eccf9aec688 req-a1e4ece0-1a86-47bf-9a5e-14314d6e2d8d service nova] Releasing lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:44:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-36308150-6722-411f-bb4e-0ab70840881b tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-5410ab11-eef1-4634-9a95-eccae38a2a5d req-20fdf772-aec1-4a3f-9beb-401817885b89 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5410ab11-eef1-4634-9a95-eccae38a2a5d req-20fdf772-aec1-4a3f-9beb-401817885b89 service nova] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5410ab11-eef1-4634-9a95-eccae38a2a5d req-20fdf772-aec1-4a3f-9beb-401817885b89 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5410ab11-eef1-4634-9a95-eccae38a2a5d req-20fdf772-aec1-4a3f-9beb-401817885b89 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-5410ab11-eef1-4634-9a95-eccae38a2a5d req-20fdf772-aec1-4a3f-9beb-401817885b89 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] No waiting events found dispatching network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:41 user nova-compute[75071]: WARNING nova.compute.manager [req-5410ab11-eef1-4634-9a95-eccae38a2a5d req-20fdf772-aec1-4a3f-9beb-401817885b89 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received unexpected event network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab for instance with vm_state building and task_state spawning.
Nov 29 13:44:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c5b9ca0-ec2e-4b47-850d-baa8d6d17f35 req-72517224-dc10-468c-abf7-1d606841d283 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c5b9ca0-ec2e-4b47-850d-baa8d6d17f35 req-72517224-dc10-468c-abf7-1d606841d283 service nova] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c5b9ca0-ec2e-4b47-850d-baa8d6d17f35 req-72517224-dc10-468c-abf7-1d606841d283 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c5b9ca0-ec2e-4b47-850d-baa8d6d17f35 req-72517224-dc10-468c-abf7-1d606841d283 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c5b9ca0-ec2e-4b47-850d-baa8d6d17f35 req-72517224-dc10-468c-abf7-1d606841d283 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] No waiting events found dispatching network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:44:43 user nova-compute[75071]: WARNING nova.compute.manager [req-4c5b9ca0-ec2e-4b47-850d-baa8d6d17f35 req-72517224-dc10-468c-abf7-1d606841d283 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received unexpected event network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab for instance with vm_state building and task_state spawning.
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:44:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Instance spawned successfully.
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:44:43 user nova-compute[75071]: INFO nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 29 13:44:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:44:43 user nova-compute[75071]: INFO nova.compute.manager [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Took 6.58 seconds to build instance.
Nov 29 13:44:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cf019508-9698-4513-a67f-d685d83f53cb tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.753s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.103s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:44:43 user nova-compute[75071]: INFO nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 29 13:44:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:44:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:44:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:44:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:44:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:45:01 user nova-compute[75071]: INFO nova.compute.manager [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Terminating instance
Nov 29 13:45:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-changed-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Refreshing instance network info cache due to event network-changed-acf66a52-04f9-4e47-8fa0-b4785a8227e3. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] Acquiring lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] Acquired lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Refreshing network info cache for port acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updated VIF entry in instance network info cache for port acf66a52-04f9-4e47-8fa0-b4785a8227e3. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating instance_info_cache with network_info: [{"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-489045dd-9223-4471-a512-d780073f2ca5 req-e645667a-2323-4fa9-b202-3a61d1c6d583 service nova] Releasing lock "refresh_cache-e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:45:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Instance destroyed successfully.
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lazy-loading 'resources' on Instance uuid e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:40:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1742238052',display_name='tempest-TestVolumeBootPattern-server-1742238052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1742238052',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXdIlxxzc4+4q1ZlgiEapIMM+v/agSOxsjf5Bsc11gikD6ivR/458yw1NjPhcZIZ8ZXMVmUicc3XTq0n9rmFDbr/yf5JceiDqPwjEQyqe0OIVWjHEXlkxzbu5yOwEIdQ==',key_name='tempest-TestVolumeBootPattern-594025560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:40:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b75ecae6764ce1801dbab6253ac6c4',ramdisk_id='',reservation_id='r-t0mjkf1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2055293783',owner_user_name='tempest-TestVolumeBootPattern-2055293783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:40:21Z,user_data=None,user_id='32b037a2bbef4090a2317bfeedd8e155',uuid=e3bb613a-1a1f-423c-8ad3-8eecf66a7de9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converting VIF {"id": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "address": "fa:16:3e:b9:d2:9d", "network": {"id": "dab2f7c9-0182-4630-a79f-2bd7daf7f3ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-450301162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b75ecae6764ce1801dbab6253ac6c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf66a52-04", "ovs_interfaceid": "acf66a52-04f9-4e47-8fa0-b4785a8227e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=acf66a52-04f9-4e47-8fa0-b4785a8227e3,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf66a52-04') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_vif [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=acf66a52-04f9-4e47-8fa0-b4785a8227e3,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf66a52-04') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacf66a52-04, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9807adf-9c80-48d8-b2d1-b58337ee7f7c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:45:02 user nova-compute[75071]: INFO os_vif [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:d2:9d,bridge_name='br-int',has_traffic_filtering=True,id=acf66a52-04f9-4e47-8fa0-b4785a8227e3,network=Network(dab2f7c9-0182-4630-a79f-2bd7daf7f3ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf66a52-04')
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGWFsolM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:45:02 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a26c4c-13b3-4145-8b52-695a9beb51d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:45:02 user nova-compute[75071]: No targets found.
Nov 29 13:45:02 user nova-compute[75071]: iSNS:
Nov 29 13:45:02 user nova-compute[75071]: No targets found.
Nov 29 13:45:02 user nova-compute[75071]: STATIC:
Nov 29 13:45:02 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135
Nov 29 13:45:02 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:45:02 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:45:02 user nova-compute[75071]: FIRMWARE:
Nov 29 13:45:02 user nova-compute[75071]: No targets found.
Nov 29 13:45:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:45:02 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:45:02 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c3231f-8bf8-49e2-8d8b-cc3582b9c090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4716eac-944a-45f9-ac54-3ced04b81375]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:45:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 (non-flash)
Nov 29 13:45:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d50040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45fad32-d257-4adc-92f7-57349f0fe73a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7f4f5-4e1c-4fa8-bfa5-1e9704bca55a]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05c044-edeb-440f-ace7-db89bd818196]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84258300-6c8f-4b46-af17-f6b6650e4540]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b020f91f', '/dev/disk/by-id/scsi-23133643561343231', '/dev/disk/by-id/scsi-1SCST_BIOb020f91f-13d5a4217f312176') {{(pid=86044) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2421659-8f03-4e4d-a1f5-1a6c3c8cf39f]: (4, None) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[99db8645-f9d2-416f-8614-098b0e5a405f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac726f-b234-41fb-8249-26d665b008cf]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260]
Nov 29 13:45:02 user nova-compute[75071]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135, portal: 172.16.0.220,3260] successful.
Nov 29 13:45:02 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c1e9956-7eeb-49b0-9cbd-9382e03fb135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d50f9-dfd7-4189-8037-0cfe6f7e9de4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] <== disconnect_volume: return (303ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:45:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Deleting instance files /opt/stack/data/nova/instances/e3bb613a-1a1f-423c-8ad3-8eecf66a7de9_del
Nov 29 13:45:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Deletion of /opt/stack/data/nova/instances/e3bb613a-1a1f-423c-8ad3-8eecf66a7de9_del complete
Nov 29 13:45:02 user nova-compute[75071]: INFO nova.compute.manager [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 13:45:02 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:45:02 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:45:03 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Took 0.39 seconds to deallocate network for instance.
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-302eff4f-9f08-40bb-b653-d560c0a55329 req-396d6f52-2613-47ce-96ca-e6a0982d8720 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-vif-deleted-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:45:03 user nova-compute[75071]: INFO nova.compute.manager [req-302eff4f-9f08-40bb-b653-d560c0a55329 req-396d6f52-2613-47ce-96ca-e6a0982d8720 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Neutron deleted interface acf66a52-04f9-4e47-8fa0-b4785a8227e3; detaching it from the instance and deleting it from the info cache
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-302eff4f-9f08-40bb-b653-d560c0a55329 req-396d6f52-2613-47ce-96ca-e6a0982d8720 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-302eff4f-9f08-40bb-b653-d560c0a55329 req-396d6f52-2613-47ce-96ca-e6a0982d8720 service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Detach interface failed, port_id=acf66a52-04f9-4e47-8fa0-b4785a8227e3, reason: Instance e3bb613a-1a1f-423c-8ad3-8eecf66a7de9 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-vif-unplugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] No waiting events found dispatching network-vif-unplugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-vif-unplugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received event network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] Acquiring lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] No waiting events found dispatching network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:45:03 user nova-compute[75071]: WARNING nova.compute.manager [req-5f77141c-eb9c-4c15-b651-fc2b84b96bc6 req-3a7a5a0a-cb60-4f13-b2dd-272d5f9bdecb service nova] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Received unexpected event network-vif-plugged-acf66a52-04f9-4e47-8fa0-b4785a8227e3 for instance with vm_state active and task_state deleting.
Nov 29 13:45:03 user nova-compute[75071]: INFO nova.compute.manager [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] [instance: e3bb613a-1a1f-423c-8ad3-8eecf66a7de9] Took 0.78 seconds to detach 1 volumes for instance.
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:45:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:45:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:04 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:45:04 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:45:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:45:04 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Deleted allocations for instance e3bb613a-1a1f-423c-8ad3-8eecf66a7de9
Nov 29 13:45:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e4add45a-27ea-4655-aafa-16522ffc811b tempest-TestVolumeBootPattern-2055293783 tempest-TestVolumeBootPattern-2055293783-project-member] Lock "e3bb613a-1a1f-423c-8ad3-8eecf66a7de9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.798s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:45:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:45:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:45:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8218MB free_disk=24.981281280517578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9837f8e4-6886-4340-87d5-ec13d45575cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e2b45485-babd-407e-9ec3-9898d2ba9d48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:45:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:45:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:45:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:45:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:45:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:46:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:46:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:10 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:46:10 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=24.979328155517578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9837f8e4-6886-4340-87d5-ec13d45575cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e2b45485-babd-407e-9ec3-9898d2ba9d48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:46:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-changed-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Refreshing instance network info cache due to event network-changed-1663755f-d533-4eaa-b434-9da5aa615418. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] Acquiring lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] Acquired lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Refreshing network info cache for port 1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG nova.objects.instance [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'flavor' on Instance uuid 9837f8e4-6886-4340-87d5-ec13d45575cf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Ignoring supplied device name: /dev/vdb
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Updated VIF entry in instance network info cache for port 1663755f-d533-4eaa-b434-9da5aa615418. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Updating instance_info_cache with network_info: [{"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:20 user nova-compute[75071]: INFO nova.compute.manager [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Attaching volume 23fea645-9d71-4ce0-87ed-c03c7288ff72 to /dev/vdb
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5badc8ec-d3ab-4296-8a84-da1dc64fc0cd req-778e61d8-2619-4d7c-a07f-da08e23fe79b service nova] Releasing lock "refresh_cache-9837f8e4-6886-4340-87d5-ec13d45575cf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG os_brick.utils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9986845-8ce2-4179-af60-390dc34d454b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6412709b-382e-484f-ba46-9f886b01cf7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.055s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[357cbf13-afcd-4d8f-887a-b4bbfcbd2f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8770458b-c64a-409c-850e-349ca150f8b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:46:21 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:46:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[086ce2a7-f680-478a-aa0e-3c87d1ee26d5]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG os_brick.utils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:46:21 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Updating existing volume attachment record: a02b6aa0-aae3-40f0-84a2-323823de9af4 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:46:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-changed-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:46:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Refreshing instance network info cache due to event network-changed-da447ab2-b46a-47e1-9d7f-af5d637d95ab. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:46:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] Acquiring lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:46:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] Acquired lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:46:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Refreshing network info cache for port da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDCOPjxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:46:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:46:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:46:28 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[752dc7f8-40f6-49c0-b0bb-c0430c84af40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:46:28 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6ae53e-766f-4e46-bbf2-0d9e397281eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72] added
Nov 29 13:46:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2043c7-e126-41da-8b99-78520f6d4721]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c09104-796b-4d3a-aff5-4dfec2f43866]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDCOPjxG {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FDCOPjxG" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[811eddfa-781d-41f8-90a5-10a16f334b39]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FDCOPjxG'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15b7fdf-9440-4cd3-a260-8fdf6584edf5]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[32705340-4500-4c3f-97f1-0dc8dff5b934]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:46:28 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:46:28 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:46:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:46:28 user nova-compute[75071]: 
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac7a045-60ca-4eaa-b2e9-015a8b7eba9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260]
Nov 29 13:46:28 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260] successful.
Nov 29 13:46:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28e82a-70cb-4055-8538-6fdb2236cbac]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a99d44-3b01-421e-aa99-c54e409ed6a3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71bcc1-8e70-4aef-bb0f-300c5d18a0ae]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDCOPjxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updated VIF entry in instance network info cache for port da447ab2-b46a-47e1-9d7f-af5d637d95ab. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating instance_info_cache with network_info: [{"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fdcb4983-0d89-417d-b7d9-57aa1277bc47 req-21dceef6-2dc2-4a64-a176-c430d1f0e227 service nova] Releasing lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'flavor' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:28 user nova-compute[75071]: INFO nova.compute.manager [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Attaching volume 8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 to /dev/vdb
Nov 29 13:46:28 user nova-compute[75071]: DEBUG os_brick.utils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b9d747-7de3-4f9b-98c3-b8fdf5b603d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f48eda7-cb09-44c2-8ec3-1a75fd166540]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd003d3-4d6e-4de3-b1b8-e74dd28760c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ceeccb-7736-4cd0-9783-a17894bdf385]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:46:29 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:46:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2131caa4-c9f4-4c6b-ab0b-af564b6c16c6]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG os_brick.utils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating existing volume attachment record: 6d5bf4b5-3326-4d54-8c6d-d10be3f2ef45 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26465613336323337', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465613336323337', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'flavor' on Instance uuid 9837f8e4-6886-4340-87d5-ec13d45575cf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:46:29 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:46:29 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:46:29 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:46:29 user nova-compute[75071]:   <serial>23fea645-9d71-4ce0-87ed-c03c7288ff72</serial>
Nov 29 13:46:29 user nova-compute[75071]: </disk>
Nov 29 13:46:29 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No VIF found with MAC fa:16:3e:f2:46:f1, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59d39e68-0778-4d5c-ba60-a468f26af7f9 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:46:30 user nova-compute[75071]: INFO nova.compute.claims [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Claim successful on node user
Nov 29 13:46:30 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:46:30 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:46:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.policy [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2457f7d6a4f64d2d94a542d73403814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02fdf8ccfd7b4320b9422fd1145705cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:46:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Creating image(s)
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk 1073741824" returned: 0 in 0.048s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:46:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Successfully created port: 07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Cannot resize image /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Ensure instance console log exists: /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Successfully updated port: 07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing instance network info cache due to event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing network info cache for port 07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-01782dd1-3c11-4ea7-b620-d25dd98e1cd0 req-6d054b5e-f104-4eb3-838c-88ce8ebc41fd service nova] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:46:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance network_info: |[{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Start _get_guest_xml network_info=[{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:46:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:46:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-31944472',display_name='tempest-ServerRescueNegativeTestJSON-server-31944472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-31944472',id=47,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO+dehStNLRYoHxJMGT2IRFRJppi2SPcw8bXySNBipsf/O/e/v1efkcyw0Js6kI7NwYuurloRGghH4Abhy4wkTAUwS0gQzG5x6iYhTu3mAdPCHDdB7DZyguWPpFd7Gdnw==',key_name='tempest-keypair-1355438857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-ncqjvyoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7efc0092-90b1-4f54-8816-8841cd207cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'pci_devices' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:46:33 user nova-compute[75071]:   <uuid>7efc0092-90b1-4f54-8816-8841cd207cae</uuid>
Nov 29 13:46:33 user nova-compute[75071]:   <name>instance-0000002f</name>
Nov 29 13:46:33 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:46:33 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:46:33 user nova-compute[75071]:   <metadata>
Nov 29 13:46:33 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:46:33 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:46:33 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-31944472</nova:name>
Nov 29 13:46:33 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:46:33</nova:creationTime>
Nov 29 13:46:33 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:46:33 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:46:33 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:46:33 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:46:33 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:46:33 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:46:33 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:46:33 user nova-compute[75071]:       <nova:owner>
Nov 29 13:46:33 user nova-compute[75071]:         <nova:user uuid="2457f7d6a4f64d2d94a542d73403814f">tempest-ServerRescueNegativeTestJSON-904604817-project-member</nova:user>
Nov 29 13:46:33 user nova-compute[75071]:         <nova:project uuid="02fdf8ccfd7b4320b9422fd1145705cb">tempest-ServerRescueNegativeTestJSON-904604817</nova:project>
Nov 29 13:46:33 user nova-compute[75071]:       </nova:owner>
Nov 29 13:46:33 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:46:33 user nova-compute[75071]:       <nova:ports>
Nov 29 13:46:33 user nova-compute[75071]:         <nova:port uuid="07270a9d-85f9-4893-a199-2ade15b5b1ce">
Nov 29 13:46:33 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:46:33 user nova-compute[75071]:         </nova:port>
Nov 29 13:46:33 user nova-compute[75071]:       </nova:ports>
Nov 29 13:46:33 user nova-compute[75071]:     </nova:instance>
Nov 29 13:46:33 user nova-compute[75071]:   </metadata>
Nov 29 13:46:33 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:46:33 user nova-compute[75071]:     <system>
Nov 29 13:46:33 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:46:33 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:46:33 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:46:33 user nova-compute[75071]:       <entry name="serial">7efc0092-90b1-4f54-8816-8841cd207cae</entry>
Nov 29 13:46:33 user nova-compute[75071]:       <entry name="uuid">7efc0092-90b1-4f54-8816-8841cd207cae</entry>
Nov 29 13:46:33 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:46:33 user nova-compute[75071]:     </system>
Nov 29 13:46:33 user nova-compute[75071]:   </sysinfo>
Nov 29 13:46:33 user nova-compute[75071]:   <os>
Nov 29 13:46:33 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:46:33 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:46:33 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:46:33 user nova-compute[75071]:   </os>
Nov 29 13:46:33 user nova-compute[75071]:   <features>
Nov 29 13:46:33 user nova-compute[75071]:     <acpi/>
Nov 29 13:46:33 user nova-compute[75071]:     <apic/>
Nov 29 13:46:33 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:46:33 user nova-compute[75071]:   </features>
Nov 29 13:46:33 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:46:33 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:46:33 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:46:33 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:46:33 user nova-compute[75071]:   </clock>
Nov 29 13:46:33 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:46:33 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:46:33 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:46:33 user nova-compute[75071]:   </cpu>
Nov 29 13:46:33 user nova-compute[75071]:   <devices>
Nov 29 13:46:33 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:46:33 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:46:33 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk"/>
Nov 29 13:46:33 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:46:33 user nova-compute[75071]:     </disk>
Nov 29 13:46:33 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:46:33 user nova-compute[75071]:       <mac address="fa:16:3e:70:c7:e5"/>
Nov 29 13:46:33 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:46:33 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:46:33 user nova-compute[75071]:       <target dev="tap07270a9d-85"/>
Nov 29 13:46:33 user nova-compute[75071]:     </interface>
Nov 29 13:46:33 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:46:33 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/console.log" append="off"/>
Nov 29 13:46:33 user nova-compute[75071]:     </serial>
Nov 29 13:46:33 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:46:33 user nova-compute[75071]:     <video>
Nov 29 13:46:33 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:46:33 user nova-compute[75071]:     </video>
Nov 29 13:46:33 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:46:33 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:46:33 user nova-compute[75071]:     </rng>
Nov 29 13:46:33 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:46:33 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:46:33 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:46:33 user nova-compute[75071]:     </memballoon>
Nov 29 13:46:33 user nova-compute[75071]:   </devices>
Nov 29 13:46:33 user nova-compute[75071]: </domain>
Nov 29 13:46:33 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-31944472',display_name='tempest-ServerRescueNegativeTestJSON-server-31944472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-31944472',id=47,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO+dehStNLRYoHxJMGT2IRFRJppi2SPcw8bXySNBipsf/O/e/v1efkcyw0Js6kI7NwYuurloRGghH4Abhy4wkTAUwS0gQzG5x6iYhTu3mAdPCHDdB7DZyguWPpFd7Gdnw==',key_name='tempest-keypair-1355438857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-ncqjvyoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7efc0092-90b1-4f54-8816-8841cd207cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG os_vif [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dfa4ee4-6677-5add-a348-189e86440df1', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07270a9d-85, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07270a9d-85, col_values=(('qos', UUID('1a92788c-89e4-431c-b7e7-769814bcbf89')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07270a9d-85, col_values=(('external_ids', {'iface-id': '07270a9d-85f9-4893-a199-2ade15b5b1ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:c7:e5', 'vm-uuid': '7efc0092-90b1-4f54-8816-8841cd207cae'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:33 user nova-compute[75071]: INFO os_vif [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85')
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No VIF found with MAC fa:16:3e:70:c7:e5, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:46:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-535eb1ff-7266-4279-a1da-4d03dbd13585 req-598302d8-8e76-42f1-9458-5458ffb6b5e7 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:46:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-535eb1ff-7266-4279-a1da-4d03dbd13585 req-598302d8-8e76-42f1-9458-5458ffb6b5e7 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-535eb1ff-7266-4279-a1da-4d03dbd13585 req-598302d8-8e76-42f1-9458-5458ffb6b5e7 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-535eb1ff-7266-4279-a1da-4d03dbd13585 req-598302d8-8e76-42f1-9458-5458ffb6b5e7 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-535eb1ff-7266-4279-a1da-4d03dbd13585 req-598302d8-8e76-42f1-9458-5458ffb6b5e7 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:46:35 user nova-compute[75071]: WARNING nova.compute.manager [req-535eb1ff-7266-4279-a1da-4d03dbd13585 req-598302d8-8e76-42f1-9458-5458ffb6b5e7 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state building and task_state spawning.
Nov 29 13:46:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRkIZaDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:46:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:46:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:46:36 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8434e2-71d8-4a7f-9007-d5810690f72a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:46:36 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab751dc-2a11-461a-be68-5c7b94699c93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830] added
Nov 29 13:46:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7f55c0-6a50-4c4d-b27b-5f34783c145f]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d622f843-ed95-40ba-8fc1-db3eb9f8597c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRkIZaDO {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRkIZaDO" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18bb191-1508-432f-a449-714134c0e428]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRkIZaDO'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d760a423-48d8-4571-8268-53e21c883a95]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d664a-6b92-4569-86b8-75e4e3cbb18a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5281e322-5c4f-4975-a0fb-506c22fafaaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260]
Nov 29 13:46:36 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260] successful.
Nov 29 13:46:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9688afd-8983-477d-afb6-256f2d588326]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a229a2-5ac5-4570-bffd-d69f886d612c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:36 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:46:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:36 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:46:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e255c0-f382-4bf8-81af-8198123796e1]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:46:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRkIZaDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:46:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance spawned successfully.
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-deba2b53-b78f-4134-a009-58912eafa430 req-87ed3615-034d-481a-93d2-9ae0528e3561 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-deba2b53-b78f-4134-a009-58912eafa430 req-87ed3615-034d-481a-93d2-9ae0528e3561 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-deba2b53-b78f-4134-a009-58912eafa430 req-87ed3615-034d-481a-93d2-9ae0528e3561 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-deba2b53-b78f-4134-a009-58912eafa430 req-87ed3615-034d-481a-93d2-9ae0528e3561 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-deba2b53-b78f-4134-a009-58912eafa430 req-87ed3615-034d-481a-93d2-9ae0528e3561 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:46:37 user nova-compute[75071]: WARNING nova.compute.manager [req-deba2b53-b78f-4134-a009-58912eafa430 req-87ed3615-034d-481a-93d2-9ae0528e3561 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state building and task_state spawning.
Nov 29 13:46:37 user nova-compute[75071]: INFO nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:46:37 user nova-compute[75071]: INFO nova.compute.manager [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Took 6.83 seconds to build instance.
Nov 29 13:46:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8f62d756-c33a-46d1-8afa-bf4efd43e2c7 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.941s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26230353537663561', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230353537663561', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'flavor' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:46:37 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:46:37 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:46:37 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:46:37 user nova-compute[75071]:   <serial>8ceafc8d-8e92-4ed1-bcd5-8b3568c85830</serial>
Nov 29 13:46:37 user nova-compute[75071]: </disk>
Nov 29 13:46:37 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:46:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No VIF found with MAC fa:16:3e:bd:cd:ad, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:46:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1df083c4-4b3a-4e1a-9895-a1863a9444b4 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.518s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'flavor' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:41 user nova-compute[75071]: INFO nova.compute.manager [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Attaching volume 28cc472f-1eba-4201-802e-f78032b741a0 to /dev/vdc
Nov 29 13:46:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa991ba-3a4f-4c22-8acd-25bb50483713]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6ebe4-8e55-478f-812c-9816b4798d9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeac451a-c03d-4651-bca9-0a2169da9b54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0bd00c-0730-4abf-8849-88e0132473ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:46:41 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:46:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ae374-8f2b-4dcb-9c93-8dcfd334acd8]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:46:41 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating existing volume attachment record: 6e681023-b037-452a-9275-a4ecc9bfab2a {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvFjouZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:46:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:46:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:46:49 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd4972-a943-42ad-bd40-609b0351e25a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:46:49 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1343245-c689-4b34-9fbb-60d47e198d12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0] added
Nov 29 13:46:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a87d3b-bfce-40e6-a3b7-e72fabfe946c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc48a094-1d0e-4d58-b09b-270fd8437230]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvFjouZP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvFjouZP" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f0899-2202-4669-bdf7-c16a470ba7d2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvFjouZP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79326f1-5d3c-4456-af9f-26f2ccf602e5]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40036895-5928-4c57-96a4-dda1c32885b4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[679592cf-a5d5-4914-bf4e-601a1c105d22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260]
Nov 29 13:46:49 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260] successful.
Nov 29 13:46:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1aa802-80fd-48f8-a3e7-91bff915c1f0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[682f58e4-cd9e-4b36-a1f4-0eb99ba99c10]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 (non-flash)
Nov 29 13:46:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef75d355-7669-4461-8e4a-9282ac28cbde]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:46:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvFjouZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:46:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:46:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26262356465626464', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:46:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262356465626464', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:46:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'flavor' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:46:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:46:50 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:46:50 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:46:50 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:46:50 user nova-compute[75071]:   <serial>28cc472f-1eba-4201-802e-f78032b741a0</serial>
Nov 29 13:46:50 user nova-compute[75071]: </disk>
Nov 29 13:46:50 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:46:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:46:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] No VIF found with MAC fa:16:3e:bd:cd:ad, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:46:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-11527892-5871-4cbd-af67-54346baea88b tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.670s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:46:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:52 user nova-compute[75071]: INFO nova.compute.manager [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Detaching volume 28cc472f-1eba-4201-802e-f78032b741a0
Nov 29 13:46:52 user nova-compute[75071]: INFO nova.virt.block_device [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Attempting to driver detach volume 28cc472f-1eba-4201-802e-f78032b741a0 from mountpoint /dev/vdc
Nov 29 13:46:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Attempting to detach device vdc from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:46:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:46:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:46:52 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:46:52 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:46:52 user nova-compute[75071]:   <serial>28cc472f-1eba-4201-802e-f78032b741a0</serial>
Nov 29 13:46:52 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 13:46:52 user nova-compute[75071]: </disk>
Nov 29 13:46:52 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:46:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Successfully detached device vdc from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the persistent domain config.
Nov 29 13:46:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:46:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:46:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:46:52 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Nov 29 13:46:52 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Nov 29 13:46:52 user nova-compute[75071]:   <serial>28cc472f-1eba-4201-802e-f78032b741a0</serial>
Nov 29 13:46:52 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 13:46:52 user nova-compute[75071]: </disk>
Nov 29 13:46:52 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:46:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:46:55 user nova-compute[75071]: INFO nova.compute.manager [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Detaching volume 23fea645-9d71-4ce0-87ed-c03c7288ff72
Nov 29 13:46:55 user nova-compute[75071]: INFO nova.virt.block_device [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Attempting to driver detach volume 23fea645-9d71-4ce0-87ed-c03c7288ff72 from mountpoint /dev/vdb
Nov 29 13:46:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Attempting to detach device vdb from instance 9837f8e4-6886-4340-87d5-ec13d45575cf from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:46:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:46:55 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:46:55 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:46:55 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:46:55 user nova-compute[75071]:   <serial>23fea645-9d71-4ce0-87ed-c03c7288ff72</serial>
Nov 29 13:46:55 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:46:55 user nova-compute[75071]: </disk>
Nov 29 13:46:55 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:46:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully detached device vdb from instance 9837f8e4-6886-4340-87d5-ec13d45575cf from the persistent domain config.
Nov 29 13:46:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9837f8e4-6886-4340-87d5-ec13d45575cf from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:46:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:46:55 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:46:55 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:46:55 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:46:55 user nova-compute[75071]:   <serial>23fea645-9d71-4ce0-87ed-c03c7288ff72</serial>
Nov 29 13:46:55 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:46:55 user nova-compute[75071]: </disk>
Nov 29 13:46:55 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:46:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:46:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9837f8e4-6886-4340-87d5-ec13d45575cf {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:46:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:46:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:47:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:47:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:47:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:47:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:47:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:47:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:47:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:47:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:47:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8408MB free_disk=24.948070526123047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 9837f8e4-6886-4340-87d5-ec13d45575cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e2b45485-babd-407e-9ec3-9898d2ba9d48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7efc0092-90b1-4f54-8816-8841cd207cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:47:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:47:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:47:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:47:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 is timed out.
Nov 29 13:47:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Successfully detached device vdc from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the live domain config.
Nov 29 13:47:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvFjouZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:47:13 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c7d09-15d9-4fb2-a608-851047fc3f48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:47:13 user nova-compute[75071]: No targets found.
Nov 29 13:47:13 user nova-compute[75071]: iSNS:
Nov 29 13:47:13 user nova-compute[75071]: No targets found.
Nov 29 13:47:13 user nova-compute[75071]: STATIC:
Nov 29 13:47:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0
Nov 29 13:47:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:47:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:47:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830
Nov 29 13:47:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:47:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:47:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72
Nov 29 13:47:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:47:13 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:47:13 user nova-compute[75071]: FIRMWARE:
Nov 29 13:47:13 user nova-compute[75071]: No targets found.
Nov 29 13:47:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:47:13 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:47:13 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6748c9-8f87-484e-b140-606ad04146c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec5dcc5-27ae-439a-bf38-c42d25051154]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:47:13 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:47:13 user nova-compute[75071]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 (non-flash)
Nov 29 13:47:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:47:13 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:47:13 user nova-compute[75071]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 (non-flash)
Nov 29 13:47:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d51e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9b090-e5c1-45a9-8cac-2bf8fe8b21ae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56eab90-cc1e-423c-992a-09b0729b75c7]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42456ca0-71f8-40ad-b637-dd6cd9f219fc]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3c48a0-baae-4181-ba17-9ae4fa62ef21]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01776181-e6d6-496f-bd7d-5057de27c47d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e863abc5-3a3d-4a81-ac11-c69b5432ed95]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260]
Nov 29 13:47:13 user nova-compute[75071]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0, portal: 172.16.0.220,3260] successful.
Nov 29 13:47:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28cc472f-1eba-4201-802e-f78032b741a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75047c9-96e8-45de-a76d-f4e009ed54be]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] <== disconnect_volume: return (320ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:47:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'flavor' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:47:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-41b8fa3b-5894-408f-9ef6-4bf5646df2a1 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.698s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9837f8e4-6886-4340-87d5-ec13d45575cf is timed out.
Nov 29 13:47:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully detached device vdb from instance 9837f8e4-6886-4340-87d5-ec13d45575cf from the live domain config.
Nov 29 13:47:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDCOPjxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:47:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d3b88-9eb9-4ee1-b84e-9eb71b13d786]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:47:16 user nova-compute[75071]: No targets found.
Nov 29 13:47:16 user nova-compute[75071]: iSNS:
Nov 29 13:47:16 user nova-compute[75071]: No targets found.
Nov 29 13:47:16 user nova-compute[75071]: STATIC:
Nov 29 13:47:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830
Nov 29 13:47:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:47:16 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:47:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72
Nov 29 13:47:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:47:16 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:47:16 user nova-compute[75071]: FIRMWARE:
Nov 29 13:47:16 user nova-compute[75071]: No targets found.
Nov 29 13:47:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:47:16 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:47:16 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7900d6f3-94d3-46d9-a73f-356c5ada8484]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2193683e-9cf5-42ed-b599-eb09e9f9ea57]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:47:16 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:47:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 (non-flash)
Nov 29 13:47:16 user nova-compute[75071]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:47:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d539a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba501b7-a78b-45da-92eb-d07d667e76c2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32c7886-09a7-480b-beee-ff43a505406f]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678b0f4-061e-433c-9822-8baac293a513]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b11d27f-6921-48c4-ad69-5bed577676d8]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4938a408-482b-4083-8bdd-ff6e881efb91]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5acff17-68c4-4731-94f1-1f8a275618db]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260]
Nov 29 13:47:16 user nova-compute[75071]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72, portal: 172.16.0.220,3260] successful.
Nov 29 13:47:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[682560fb-d18a-4de2-8b8c-f74c86fccb3e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== disconnect_volume: return (275ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:47:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'flavor' on Instance uuid 9837f8e4-6886-4340-87d5-ec13d45575cf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ad950c6f-8fc4-474f-8f8f-96c7eee1852d tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.549s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:17 user nova-compute[75071]: INFO nova.compute.manager [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Terminating instance
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-60bf27dd-acb3-444e-803c-41d2bc2a24a7 req-1d7a3730-88a8-4b62-9346-ad519cec298f service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-vif-unplugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-60bf27dd-acb3-444e-803c-41d2bc2a24a7 req-1d7a3730-88a8-4b62-9346-ad519cec298f service nova] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-60bf27dd-acb3-444e-803c-41d2bc2a24a7 req-1d7a3730-88a8-4b62-9346-ad519cec298f service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-60bf27dd-acb3-444e-803c-41d2bc2a24a7 req-1d7a3730-88a8-4b62-9346-ad519cec298f service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-60bf27dd-acb3-444e-803c-41d2bc2a24a7 req-1d7a3730-88a8-4b62-9346-ad519cec298f service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] No waiting events found dispatching network-vif-unplugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-60bf27dd-acb3-444e-803c-41d2bc2a24a7 req-1d7a3730-88a8-4b62-9346-ad519cec298f service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-vif-unplugged-1663755f-d533-4eaa-b434-9da5aa615418 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Instance destroyed successfully.
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'resources' on Instance uuid 9837f8e4-6886-4340-87d5-ec13d45575cf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:44:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1628909320',display_name='tempest-VolumesSnapshotTestJSON-instance-1628909320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1628909320',id=45,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxk56yqhT17nN7YerNpfZ8kQgyhcbN2YuA53S3CaI1uHVcIy7FXSm1Yrb9uzyi/2QF+3PL5jOVkGTyGsNbACfQLNiUE17G5San/GYYNlkQOWDbOKuVlQa8v0xrpsq9wCQ==',key_name='tempest-keypair-864825811',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:44:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5efc039a35ea4aecb0d420a1e2a7e2df',ramdisk_id='',reservation_id='r-8kiosr7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-815296959',owner_user_name='tempest-VolumesSnapshotTestJSON-815296959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:44:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d3f4fb84c6f4856839c72b68614ce90',uuid=9837f8e4-6886-4340-87d5-ec13d45575cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converting VIF {"id": "1663755f-d533-4eaa-b434-9da5aa615418", "address": "fa:16:3e:f2:46:f1", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1663755f-d5", "ovs_interfaceid": "1663755f-d533-4eaa-b434-9da5aa615418", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=1663755f-d533-4eaa-b434-9da5aa615418,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663755f-d5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_vif [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=1663755f-d533-4eaa-b434-9da5aa615418,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663755f-d5') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1663755f-d5, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08891bab-287c-4104-9439-7905ca5a5001) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:47:17 user nova-compute[75071]: INFO os_vif [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:46:f1,bridge_name='br-int',has_traffic_filtering=True,id=1663755f-d533-4eaa-b434-9da5aa615418,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1663755f-d5')
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FDCOPjxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:47:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[340e6688-416e-4509-aff8-9c70c846a87e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:47:17 user nova-compute[75071]: No targets found.
Nov 29 13:47:17 user nova-compute[75071]: iSNS:
Nov 29 13:47:17 user nova-compute[75071]: No targets found.
Nov 29 13:47:17 user nova-compute[75071]: STATIC:
Nov 29 13:47:17 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830
Nov 29 13:47:17 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:47:17 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:47:17 user nova-compute[75071]: FIRMWARE:
Nov 29 13:47:17 user nova-compute[75071]: No targets found.
Nov 29 13:47:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:47:17 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:47:17 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23fea645-9d71-4ce0-87ed-c03c7288ff72', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a462d62-3b19-44af-b1f3-4923debf6415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d395c89c-45fa-419e-9bb3-e6dcadc13845]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:47:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:47:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148410700>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== disconnect_volume: return (64ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:47:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:47:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Deleting instance files /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf_del
Nov 29 13:47:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Deletion of /opt/stack/data/nova/instances/9837f8e4-6886-4340-87d5-ec13d45575cf_del complete
Nov 29 13:47:18 user nova-compute[75071]: INFO nova.compute.manager [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 13:47:18 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:47:18 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:47:18 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:47:18 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:47:18 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Took 0.68 seconds to deallocate network for instance.
Nov 29 13:47:18 user nova-compute[75071]: WARNING nova.volume.cinder [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Attachment a02b6aa0-aae3-40f0-84a2-323823de9af4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a02b6aa0-aae3-40f0-84a2-323823de9af4. (HTTP 404) (Request-ID: req-e36172b9-dde7-46cc-9e39-a4b42b7f1265)
Nov 29 13:47:18 user nova-compute[75071]: INFO nova.compute.manager [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Took 0.02 seconds to detach 1 volumes for instance.
Nov 29 13:47:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:47:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:47:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:47:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:19 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Deleted allocations for instance 9837f8e4-6886-4340-87d5-ec13d45575cf
Nov 29 13:47:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6104f906-f941-4e09-9173-3668b74dba01 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.999s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-98e6cdc3-3e16-4d9e-83ce-e88d4598d7c1 req-a4fbad67-a132-4047-ac7c-a8b49bf989ac service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:47:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-98e6cdc3-3e16-4d9e-83ce-e88d4598d7c1 req-a4fbad67-a132-4047-ac7c-a8b49bf989ac service nova] Acquiring lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:47:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-98e6cdc3-3e16-4d9e-83ce-e88d4598d7c1 req-a4fbad67-a132-4047-ac7c-a8b49bf989ac service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-98e6cdc3-3e16-4d9e-83ce-e88d4598d7c1 req-a4fbad67-a132-4047-ac7c-a8b49bf989ac service nova] Lock "9837f8e4-6886-4340-87d5-ec13d45575cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:47:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-98e6cdc3-3e16-4d9e-83ce-e88d4598d7c1 req-a4fbad67-a132-4047-ac7c-a8b49bf989ac service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] No waiting events found dispatching network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:47:19 user nova-compute[75071]: WARNING nova.compute.manager [req-98e6cdc3-3e16-4d9e-83ce-e88d4598d7c1 req-a4fbad67-a132-4047-ac7c-a8b49bf989ac service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received unexpected event network-vif-plugged-1663755f-d533-4eaa-b434-9da5aa615418 for instance with vm_state deleted and task_state None.
Nov 29 13:47:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-98e6cdc3-3e16-4d9e-83ce-e88d4598d7c1 req-a4fbad67-a132-4047-ac7c-a8b49bf989ac service nova] [instance: 9837f8e4-6886-4340-87d5-ec13d45575cf] Received event network-vif-deleted-1663755f-d533-4eaa-b434-9da5aa615418 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:47:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:47:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:47:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:47:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:47:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:47:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:47:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:47:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:47:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:47:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:47:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:47:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:47:43 user nova-compute[75071]: INFO nova.compute.manager [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Detaching volume 8ceafc8d-8e92-4ed1-bcd5-8b3568c85830
Nov 29 13:47:43 user nova-compute[75071]: INFO nova.virt.block_device [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Attempting to driver detach volume 8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 from mountpoint /dev/vdb
Nov 29 13:47:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Attempting to detach device vdb from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:47:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:47:43 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:47:43 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:47:43 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:47:43 user nova-compute[75071]:   <serial>8ceafc8d-8e92-4ed1-bcd5-8b3568c85830</serial>
Nov 29 13:47:43 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:47:43 user nova-compute[75071]: </disk>
Nov 29 13:47:43 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:47:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Successfully detached device vdb from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the persistent domain config.
Nov 29 13:47:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:47:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:47:43 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:47:43 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:47:43 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:47:43 user nova-compute[75071]:   <serial>8ceafc8d-8e92-4ed1-bcd5-8b3568c85830</serial>
Nov 29 13:47:43 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:47:43 user nova-compute[75071]: </disk>
Nov 29 13:47:43 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:47:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:47:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:47:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:47:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:48:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 is timed out.
Nov 29 13:48:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Successfully detached device vdb from instance e2b45485-babd-407e-9ec3-9898d2ba9d48 from the live domain config.
Nov 29 13:48:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRkIZaDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:48:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0423f5-edea-48d1-a58a-f7406e45dd42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:48:03 user nova-compute[75071]: No targets found.
Nov 29 13:48:03 user nova-compute[75071]: iSNS:
Nov 29 13:48:03 user nova-compute[75071]: No targets found.
Nov 29 13:48:03 user nova-compute[75071]: STATIC:
Nov 29 13:48:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830
Nov 29 13:48:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:48:03 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:48:03 user nova-compute[75071]: FIRMWARE:
Nov 29 13:48:03 user nova-compute[75071]: No targets found.
Nov 29 13:48:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:48:03 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:48:03 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7717bf6-a63b-4497-a92a-cf502d15ac7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98a7a5-147a-4445-9cd0-e7ad4317a3c7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:48:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 (non-flash)
Nov 29 13:48:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e1b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb62773-206b-4a95-9bb0-77d4c4c04288]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c980cd-a4d0-4016-afd1-ad4e95e80b29]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b52329f-c097-4500-b90a-4015dacd1047]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ff45e-ee83-4667-a780-74634516adb3]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea46279-cdb3-42c4-8392-28ece5d2720d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fd52c6-ebf3-4f83-b929-306df9ed9f7a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260]
Nov 29 13:48:03 user nova-compute[75071]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830, portal: 172.16.0.220,3260] successful.
Nov 29 13:48:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ceafc8d-8e92-4ed1-bcd5-8b3568c85830 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c817a3-ee03-4018-874f-29f6cef6931c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] <== disconnect_volume: return (278ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:48:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:48:04 user nova-compute[75071]: INFO nova.compute.claims [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Claim successful on node user
Nov 29 13:48:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'flavor' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9a759c5-0d8b-410d-b2af-409016cdb886 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:48:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:48:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.policy [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d3f4fb84c6f4856839c72b68614ce90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5efc039a35ea4aecb0d420a1e2a7e2df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:48:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Creating image(s)
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "/opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "/opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk 1073741824" returned: 0 in 0.051s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Successfully created port: e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:48:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Cannot resize image /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Ensure instance console log exists: /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Successfully updated port: e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquired lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-changed-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Refreshing instance network info cache due to event network-changed-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] Acquiring lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating instance_info_cache with network_info: [{"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-e2b45485-babd-407e-9ec3-9898d2ba9d48" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Updating instance_info_cache with network_info: [{"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Releasing lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Instance network_info: |[{"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] Acquired lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Refreshing network info cache for port e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Start _get_guest_xml network_info=[{"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:48:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:48:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1904233600',display_name='tempest-VolumesSnapshotTestJSON-instance-1904233600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1904233600',id=48,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4uKBBihemPTo5/qMu3IgWuEx3T0H7gTj1JebYCqPP3k8/MEKHzp3nRsK4mkBUXI2kQebU+7Nu2+TAhbVzqIZtM8KKOn8we/w0Dcp6Kc0TomxnrqIFS4WXFvsCZ5apMVQ==',key_name='tempest-keypair-1787284326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efc039a35ea4aecb0d420a1e2a7e2df',ramdisk_id='',reservation_id='r-b35r8itm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815296959',owner_user_name='tempest-VolumesSnapshotTestJSON-815296959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d3f4fb84c6f4856839c72b68614ce90',uuid=e6a72f73-2d9e-4590-9e7f-a44c143f92a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converting VIF {"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:28:b4,bridge_name='br-int',has_traffic_filtering=True,id=e32dcdeb-c788-4ca5-a73e-1c26ba69de0a,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32dcdeb-c7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'pci_devices' on Instance uuid e6a72f73-2d9e-4590-9e7f-a44c143f92a0 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:48:06 user nova-compute[75071]:   <uuid>e6a72f73-2d9e-4590-9e7f-a44c143f92a0</uuid>
Nov 29 13:48:06 user nova-compute[75071]:   <name>instance-00000030</name>
Nov 29 13:48:06 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:48:06 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:48:06 user nova-compute[75071]:   <metadata>
Nov 29 13:48:06 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:48:06 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:48:06 user nova-compute[75071]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1904233600</nova:name>
Nov 29 13:48:06 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:48:06</nova:creationTime>
Nov 29 13:48:06 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:48:06 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:48:06 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:48:06 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:48:06 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:48:06 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:48:06 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:48:06 user nova-compute[75071]:       <nova:owner>
Nov 29 13:48:06 user nova-compute[75071]:         <nova:user uuid="0d3f4fb84c6f4856839c72b68614ce90">tempest-VolumesSnapshotTestJSON-815296959-project-member</nova:user>
Nov 29 13:48:06 user nova-compute[75071]:         <nova:project uuid="5efc039a35ea4aecb0d420a1e2a7e2df">tempest-VolumesSnapshotTestJSON-815296959</nova:project>
Nov 29 13:48:06 user nova-compute[75071]:       </nova:owner>
Nov 29 13:48:06 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:48:06 user nova-compute[75071]:       <nova:ports>
Nov 29 13:48:06 user nova-compute[75071]:         <nova:port uuid="e32dcdeb-c788-4ca5-a73e-1c26ba69de0a">
Nov 29 13:48:06 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:48:06 user nova-compute[75071]:         </nova:port>
Nov 29 13:48:06 user nova-compute[75071]:       </nova:ports>
Nov 29 13:48:06 user nova-compute[75071]:     </nova:instance>
Nov 29 13:48:06 user nova-compute[75071]:   </metadata>
Nov 29 13:48:06 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:48:06 user nova-compute[75071]:     <system>
Nov 29 13:48:06 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:48:06 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:48:06 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:48:06 user nova-compute[75071]:       <entry name="serial">e6a72f73-2d9e-4590-9e7f-a44c143f92a0</entry>
Nov 29 13:48:06 user nova-compute[75071]:       <entry name="uuid">e6a72f73-2d9e-4590-9e7f-a44c143f92a0</entry>
Nov 29 13:48:06 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:48:06 user nova-compute[75071]:     </system>
Nov 29 13:48:06 user nova-compute[75071]:   </sysinfo>
Nov 29 13:48:06 user nova-compute[75071]:   <os>
Nov 29 13:48:06 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:48:06 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:48:06 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:48:06 user nova-compute[75071]:   </os>
Nov 29 13:48:06 user nova-compute[75071]:   <features>
Nov 29 13:48:06 user nova-compute[75071]:     <acpi/>
Nov 29 13:48:06 user nova-compute[75071]:     <apic/>
Nov 29 13:48:06 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:48:06 user nova-compute[75071]:   </features>
Nov 29 13:48:06 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:48:06 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:48:06 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:48:06 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:48:06 user nova-compute[75071]:   </clock>
Nov 29 13:48:06 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:48:06 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:48:06 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:48:06 user nova-compute[75071]:   </cpu>
Nov 29 13:48:06 user nova-compute[75071]:   <devices>
Nov 29 13:48:06 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:48:06 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:48:06 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk"/>
Nov 29 13:48:06 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:48:06 user nova-compute[75071]:     </disk>
Nov 29 13:48:06 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:48:06 user nova-compute[75071]:       <mac address="fa:16:3e:30:28:b4"/>
Nov 29 13:48:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:48:06 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:48:06 user nova-compute[75071]:       <target dev="tape32dcdeb-c7"/>
Nov 29 13:48:06 user nova-compute[75071]:     </interface>
Nov 29 13:48:06 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:48:06 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/console.log" append="off"/>
Nov 29 13:48:06 user nova-compute[75071]:     </serial>
Nov 29 13:48:06 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:48:06 user nova-compute[75071]:     <video>
Nov 29 13:48:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:48:06 user nova-compute[75071]:     </video>
Nov 29 13:48:06 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:48:06 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:48:06 user nova-compute[75071]:     </rng>
Nov 29 13:48:06 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:48:06 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:48:06 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:48:06 user nova-compute[75071]:     </memballoon>
Nov 29 13:48:06 user nova-compute[75071]:   </devices>
Nov 29 13:48:06 user nova-compute[75071]: </domain>
Nov 29 13:48:06 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1904233600',display_name='tempest-VolumesSnapshotTestJSON-instance-1904233600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1904233600',id=48,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4uKBBihemPTo5/qMu3IgWuEx3T0H7gTj1JebYCqPP3k8/MEKHzp3nRsK4mkBUXI2kQebU+7Nu2+TAhbVzqIZtM8KKOn8we/w0Dcp6Kc0TomxnrqIFS4WXFvsCZ5apMVQ==',key_name='tempest-keypair-1787284326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5efc039a35ea4aecb0d420a1e2a7e2df',ramdisk_id='',reservation_id='r-b35r8itm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815296959',owner_user_name='tempest-VolumesSnapshotTestJSON-815296959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:48:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d3f4fb84c6f4856839c72b68614ce90',uuid=e6a72f73-2d9e-4590-9e7f-a44c143f92a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converting VIF {"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:28:b4,bridge_name='br-int',has_traffic_filtering=True,id=e32dcdeb-c788-4ca5-a73e-1c26ba69de0a,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32dcdeb-c7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG os_vif [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:28:b4,bridge_name='br-int',has_traffic_filtering=True,id=e32dcdeb-c788-4ca5-a73e-1c26ba69de0a,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32dcdeb-c7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59d01c24-62cc-582f-aeec-6d3f3647fab8', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape32dcdeb-c7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape32dcdeb-c7, col_values=(('qos', UUID('b4ed4863-d084-49a7-9980-2363e88acfa5')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape32dcdeb-c7, col_values=(('external_ids', {'iface-id': 'e32dcdeb-c788-4ca5-a73e-1c26ba69de0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:28:b4', 'vm-uuid': 'e6a72f73-2d9e-4590-9e7f-a44c143f92a0'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:06 user nova-compute[75071]: INFO os_vif [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:28:b4,bridge_name='br-int',has_traffic_filtering=True,id=e32dcdeb-c788-4ca5-a73e-1c26ba69de0a,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32dcdeb-c7')
Nov 29 13:48:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:48:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No VIF found with MAC fa:16:3e:30:28:b4, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:48:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Updated VIF entry in instance network info cache for port e32dcdeb-c788-4ca5-a73e-1c26ba69de0a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:48:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Updating instance_info_cache with network_info: [{"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:48:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c0698af6-ea6e-4020-ba81-9ce646c5cb86 req-60caf8b1-4994-4d07-9841-18bff54302eb service nova] Releasing lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e3575d6-176d-4b43-aacf-f3ca570f8b2b req-e61bcfc5-d3c6-48c9-9525-619dbcc0ba9b service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e3575d6-176d-4b43-aacf-f3ca570f8b2b req-e61bcfc5-d3c6-48c9-9525-619dbcc0ba9b service nova] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e3575d6-176d-4b43-aacf-f3ca570f8b2b req-e61bcfc5-d3c6-48c9-9525-619dbcc0ba9b service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e3575d6-176d-4b43-aacf-f3ca570f8b2b req-e61bcfc5-d3c6-48c9-9525-619dbcc0ba9b service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e3575d6-176d-4b43-aacf-f3ca570f8b2b req-e61bcfc5-d3c6-48c9-9525-619dbcc0ba9b service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] No waiting events found dispatching network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:08 user nova-compute[75071]: WARNING nova.compute.manager [req-4e3575d6-176d-4b43-aacf-f3ca570f8b2b req-e61bcfc5-d3c6-48c9-9525-619dbcc0ba9b service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received unexpected event network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a for instance with vm_state building and task_state spawning.
Nov 29 13:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:48:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Instance spawned successfully.
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:48:10 user nova-compute[75071]: INFO nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:10 user nova-compute[75071]: INFO nova.compute.manager [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Took 6.00 seconds to build instance.
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-676a4df5-9ae6-4cf5-8c32-23a398f0d61b req-bfc4abe5-d57b-4192-8af8-277aa6c866b9 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-676a4df5-9ae6-4cf5-8c32-23a398f0d61b req-bfc4abe5-d57b-4192-8af8-277aa6c866b9 service nova] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-676a4df5-9ae6-4cf5-8c32-23a398f0d61b req-bfc4abe5-d57b-4192-8af8-277aa6c866b9 service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-676a4df5-9ae6-4cf5-8c32-23a398f0d61b req-bfc4abe5-d57b-4192-8af8-277aa6c866b9 service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-676a4df5-9ae6-4cf5-8c32-23a398f0d61b req-bfc4abe5-d57b-4192-8af8-277aa6c866b9 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] No waiting events found dispatching network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:10 user nova-compute[75071]: WARNING nova.compute.manager [req-676a4df5-9ae6-4cf5-8c32-23a398f0d61b req-bfc4abe5-d57b-4192-8af8-277aa6c866b9 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received unexpected event network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a for instance with vm_state active and task_state None.
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f47ae353-4368-4b3c-9ef0-eff33f5e1c45 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.104s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:48:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8580MB free_disk=24.965919494628906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e2b45485-babd-407e-9ec3-9898d2ba9d48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7efc0092-90b1-4f54-8816-8841cd207cae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:48:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:48:12 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:48:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:48:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing instance network info cache due to event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing network info cache for port 07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'flavor' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:21 user nova-compute[75071]: INFO nova.compute.manager [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Attaching volume 3244650a-1fe5-40a0-8d81-7c7851cf2f34 to /dev/vdb
Nov 29 13:48:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updated VIF entry in instance network info cache for port 07270a9d-85f9-4893-a199-2ade15b5b1ce. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5e7b2a14-5706-4955-9aa4-c181f3c45702 req-2c0b1907-8a65-4279-a1d6-6b5415c1b968 service nova] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG os_brick.utils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d062c813-fbaa-4915-9f22-45367e874f83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[519afa19-c3ae-43db-ad1f-fc7904b0a734]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1310fc27-bdd9-4e72-a1be-c408d57c8eb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[002af82a-5391-433f-ace5-ecfffd465c6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:48:21 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:48:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19f1b8e-4d86-4e1c-ad4c-a8e0985ae395]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG os_brick.utils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating existing volume attachment record: 039ce649-336a-40a0-bbd7-9d8df787256b {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:48:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVYZQnzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:48:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:48:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:48:31 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f8454-d88d-43cd-8893-f66d10785d7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:48:31 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e3629-3cdb-4a8c-b6a3-9d128cb8f48d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34] added
Nov 29 13:48:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db490142-d8e3-419b-a62d-496135f9fb91]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09537471-2e86-4257-af9e-8630924a4fb4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVYZQnzh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVYZQnzh" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f98b46-b329-4280-8d6b-e214929484ab]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bVYZQnzh'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd66fe4-a98c-4854-9554-01e5ed479e02]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba541870-dbe6-48b6-b79a-e49f7ba7e52b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:48:32 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:48:32 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:48:32 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:48:32 user nova-compute[75071]: 
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee3f81-a4a6-4eb3-b5f5-12f8b2e1a81a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260]
Nov 29 13:48:32 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260] successful.
Nov 29 13:48:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcf30a8-78b1-4fc5-abf5-4d15fc292149]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b0c71-dd98-4a7a-a73d-35796a3270bf]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:48:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:48:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c1dbc4-5861-42ab-880c-c31da1afda2b]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:48:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVYZQnzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23139653539613637', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139653539613637', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'flavor' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:48:33 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:48:33 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:48:33 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:48:33 user nova-compute[75071]:   <serial>3244650a-1fe5-40a0-8d81-7c7851cf2f34</serial>
Nov 29 13:48:33 user nova-compute[75071]: </disk>
Nov 29 13:48:33 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:33 user nova-compute[75071]: INFO nova.compute.manager [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Terminating instance
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No VIF found with MAC fa:16:3e:70:c7:e5, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-51e2f13c-731d-486b-9fb7-b2d840a2fe79 req-0048c420-d217-4800-8f73-74ef191c7b98 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-vif-unplugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51e2f13c-731d-486b-9fb7-b2d840a2fe79 req-0048c420-d217-4800-8f73-74ef191c7b98 service nova] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51e2f13c-731d-486b-9fb7-b2d840a2fe79 req-0048c420-d217-4800-8f73-74ef191c7b98 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51e2f13c-731d-486b-9fb7-b2d840a2fe79 req-0048c420-d217-4800-8f73-74ef191c7b98 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-51e2f13c-731d-486b-9fb7-b2d840a2fe79 req-0048c420-d217-4800-8f73-74ef191c7b98 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] No waiting events found dispatching network-vif-unplugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-51e2f13c-731d-486b-9fb7-b2d840a2fe79 req-0048c420-d217-4800-8f73-74ef191c7b98 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-vif-unplugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:48:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d04af11a-9d07-48c9-806a-e5132558eed5 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.141s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Instance destroyed successfully.
Nov 29 13:48:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lazy-loading 'resources' on Instance uuid e2b45485-babd-407e-9ec3-9898d2ba9d48 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1989015771',display_name='tempest-TestServerVolumeAttachmentScenario-server-1989015771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1989015771',id=46,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSd72QI9JuMhV2wcN2hBkV9ZtP1bJ9oSEwcGrcq8Sh5Q0ZAgBAf8Q69DiqUF9n4CTEHKFhNm9RkTiEoOKh44+ZhhVLJ/DSVroZPqp4P8qLLDPwQDG5sCWLT83Dzw4uI/w==',key_name='tempest-keypair-1747896639',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f633d9dae01471ebf7006305703d7cd',ramdisk_id='',reservation_id='r-zvw49i97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-67934131',owner_user_name='tempest-TestServerVolumeAttachmentScenario-67934131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddc6592629034ddeb9fe2fbfd607afed',uuid=e2b45485-babd-407e-9ec3-9898d2ba9d48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Converting VIF {"id": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "address": "fa:16:3e:bd:cd:ad", "network": {"id": "dbd635a5-84f5-42b1-ac93-fec02a9443bb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-228802189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f633d9dae01471ebf7006305703d7cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda447ab2-b4", "ovs_interfaceid": "da447ab2-b46a-47e1-9d7f-af5d637d95ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:cd:ad,bridge_name='br-int',has_traffic_filtering=True,id=da447ab2-b46a-47e1-9d7f-af5d637d95ab,network=Network(dbd635a5-84f5-42b1-ac93-fec02a9443bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda447ab2-b4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG os_vif [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:cd:ad,bridge_name='br-int',has_traffic_filtering=True,id=da447ab2-b46a-47e1-9d7f-af5d637d95ab,network=Network(dbd635a5-84f5-42b1-ac93-fec02a9443bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda447ab2-b4') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda447ab2-b4, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4285382-fedb-4c54-b1ec-c3fcad476735) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:34 user nova-compute[75071]: INFO os_vif [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:cd:ad,bridge_name='br-int',has_traffic_filtering=True,id=da447ab2-b46a-47e1-9d7f-af5d637d95ab,network=Network(dbd635a5-84f5-42b1-ac93-fec02a9443bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda447ab2-b4')
Nov 29 13:48:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Deleting instance files /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48_del
Nov 29 13:48:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Deletion of /opt/stack/data/nova/instances/e2b45485-babd-407e-9ec3-9898d2ba9d48_del complete
Nov 29 13:48:34 user nova-compute[75071]: INFO nova.compute.manager [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 13:48:34 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-d8d1e384-1a2d-4811-8363-c9c5ea1fa102 req-3fefa088-f300-46d2-878f-20fd4cac52b7 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-vif-deleted-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:35 user nova-compute[75071]: INFO nova.compute.manager [req-d8d1e384-1a2d-4811-8363-c9c5ea1fa102 req-3fefa088-f300-46d2-878f-20fd4cac52b7 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Neutron deleted interface da447ab2-b46a-47e1-9d7f-af5d637d95ab; detaching it from the instance and deleting it from the info cache
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-d8d1e384-1a2d-4811-8363-c9c5ea1fa102 req-3fefa088-f300-46d2-878f-20fd4cac52b7 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:48:35 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Took 0.86 seconds to deallocate network for instance.
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-d8d1e384-1a2d-4811-8363-c9c5ea1fa102 req-3fefa088-f300-46d2-878f-20fd4cac52b7 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Detach interface failed, port_id=da447ab2-b46a-47e1-9d7f-af5d637d95ab, reason: Instance e2b45485-babd-407e-9ec3-9898d2ba9d48 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:35 user nova-compute[75071]: INFO nova.compute.manager [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Rescuing
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:35 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Deleted allocations for instance e2b45485-babd-407e-9ec3-9898d2ba9d48
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-94786190-ed1d-4e54-b329-daa9c7cb5124 tempest-TestServerVolumeAttachmentScenario-67934131 tempest-TestServerVolumeAttachmentScenario-67934131-project-member] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-b0fe273d-3ab4-41a6-b7b2-c7246b279e22 req-f9ed4b9f-8aea-4454-b6dd-c404f1808128 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received event network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0fe273d-3ab4-41a6-b7b2-c7246b279e22 req-f9ed4b9f-8aea-4454-b6dd-c404f1808128 service nova] Acquiring lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0fe273d-3ab4-41a6-b7b2-c7246b279e22 req-f9ed4b9f-8aea-4454-b6dd-c404f1808128 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0fe273d-3ab4-41a6-b7b2-c7246b279e22 req-f9ed4b9f-8aea-4454-b6dd-c404f1808128 service nova] Lock "e2b45485-babd-407e-9ec3-9898d2ba9d48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-b0fe273d-3ab4-41a6-b7b2-c7246b279e22 req-f9ed4b9f-8aea-4454-b6dd-c404f1808128 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] No waiting events found dispatching network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:35 user nova-compute[75071]: WARNING nova.compute.manager [req-b0fe273d-3ab4-41a6-b7b2-c7246b279e22 req-f9ed4b9f-8aea-4454-b6dd-c404f1808128 service nova] [instance: e2b45485-babd-407e-9ec3-9898d2ba9d48] Received unexpected event network-vif-plugged-da447ab2-b46a-47e1-9d7f-af5d637d95ab for instance with vm_state deleted and task_state None.
Nov 29 13:48:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-32a5b484-8393-4ab9-98a7-c983ffeb3fe1 req-43531b8e-c1d1-435a-a976-8f4ac87406f7 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-32a5b484-8393-4ab9-98a7-c983ffeb3fe1 req-43531b8e-c1d1-435a-a976-8f4ac87406f7 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-32a5b484-8393-4ab9-98a7-c983ffeb3fe1 req-43531b8e-c1d1-435a-a976-8f4ac87406f7 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-32a5b484-8393-4ab9-98a7-c983ffeb3fe1 req-43531b8e-c1d1-435a-a976-8f4ac87406f7 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-32a5b484-8393-4ab9-98a7-c983ffeb3fe1 req-43531b8e-c1d1-435a-a976-8f4ac87406f7 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:36 user nova-compute[75071]: WARNING nova.compute.manager [req-32a5b484-8393-4ab9-98a7-c983ffeb3fe1 req-43531b8e-c1d1-435a-a976-8f4ac87406f7 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state active and task_state rescuing.
Nov 29 13:48:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance destroyed successfully.
Nov 29 13:48:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Attempting rescue
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 13:48:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Creating image(s)
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue" returned: 0 in 0.059s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'migration_context' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.objects.base [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7efc0092-90b1-4f54-8816-8841cd207cae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Start _get_guest_xml network_info=[{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:70:c7:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '794347ff-8cf3-49d9-8652-9f89337799af', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'resources' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.objects.base [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7efc0092-90b1-4f54-8816-8841cd207cae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'numa_topology' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:36 user nova-compute[75071]: DEBUG nova.objects.base [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7efc0092-90b1-4f54-8816-8841cd207cae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:48:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:48:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7efc0092-90b1-4f54-8816-8841cd207cae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-31944472',display_name='tempest-ServerRescueNegativeTestJSON-server-31944472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-31944472',id=47,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO+dehStNLRYoHxJMGT2IRFRJppi2SPcw8bXySNBipsf/O/e/v1efkcyw0Js6kI7NwYuurloRGghH4Abhy4wkTAUwS0gQzG5x6iYhTu3mAdPCHDdB7DZyguWPpFd7Gdnw==',key_name='tempest-keypair-1355438857',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-ncqjvyoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7efc0092-90b1-4f54-8816-8841cd207cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:70:c7:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "vif_mac": "fa:16:3e:70:c7:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'pci_devices' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Object Instance<7efc0092-90b1-4f54-8816-8841cd207cae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:48:37 user nova-compute[75071]:   <uuid>7efc0092-90b1-4f54-8816-8841cd207cae</uuid>
Nov 29 13:48:37 user nova-compute[75071]:   <name>instance-0000002f</name>
Nov 29 13:48:37 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:48:37 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:48:37 user nova-compute[75071]:   <metadata>
Nov 29 13:48:37 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:48:37 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:48:37 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-31944472</nova:name>
Nov 29 13:48:37 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:48:37</nova:creationTime>
Nov 29 13:48:37 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:48:37 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:48:37 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:48:37 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:48:37 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:48:37 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:48:37 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:48:37 user nova-compute[75071]:       <nova:owner>
Nov 29 13:48:37 user nova-compute[75071]:         <nova:user uuid="2457f7d6a4f64d2d94a542d73403814f">tempest-ServerRescueNegativeTestJSON-904604817-project-member</nova:user>
Nov 29 13:48:37 user nova-compute[75071]:         <nova:project uuid="02fdf8ccfd7b4320b9422fd1145705cb">tempest-ServerRescueNegativeTestJSON-904604817</nova:project>
Nov 29 13:48:37 user nova-compute[75071]:       </nova:owner>
Nov 29 13:48:37 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:48:37 user nova-compute[75071]:       <nova:ports>
Nov 29 13:48:37 user nova-compute[75071]:         <nova:port uuid="07270a9d-85f9-4893-a199-2ade15b5b1ce">
Nov 29 13:48:37 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:48:37 user nova-compute[75071]:         </nova:port>
Nov 29 13:48:37 user nova-compute[75071]:       </nova:ports>
Nov 29 13:48:37 user nova-compute[75071]:     </nova:instance>
Nov 29 13:48:37 user nova-compute[75071]:   </metadata>
Nov 29 13:48:37 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:48:37 user nova-compute[75071]:     <system>
Nov 29 13:48:37 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:48:37 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:48:37 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:48:37 user nova-compute[75071]:       <entry name="serial">7efc0092-90b1-4f54-8816-8841cd207cae</entry>
Nov 29 13:48:37 user nova-compute[75071]:       <entry name="uuid">7efc0092-90b1-4f54-8816-8841cd207cae</entry>
Nov 29 13:48:37 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:48:37 user nova-compute[75071]:     </system>
Nov 29 13:48:37 user nova-compute[75071]:   </sysinfo>
Nov 29 13:48:37 user nova-compute[75071]:   <os>
Nov 29 13:48:37 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:48:37 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:48:37 user nova-compute[75071]:   </os>
Nov 29 13:48:37 user nova-compute[75071]:   <features>
Nov 29 13:48:37 user nova-compute[75071]:     <acpi/>
Nov 29 13:48:37 user nova-compute[75071]:     <apic/>
Nov 29 13:48:37 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:48:37 user nova-compute[75071]:   </features>
Nov 29 13:48:37 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:48:37 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:48:37 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:48:37 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:48:37 user nova-compute[75071]:   </clock>
Nov 29 13:48:37 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:48:37 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:48:37 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:48:37 user nova-compute[75071]:   </cpu>
Nov 29 13:48:37 user nova-compute[75071]:   <devices>
Nov 29 13:48:37 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:48:37 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:48:37 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue"/>
Nov 29 13:48:37 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:48:37 user nova-compute[75071]:     </disk>
Nov 29 13:48:37 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:48:37 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:48:37 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk"/>
Nov 29 13:48:37 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Nov 29 13:48:37 user nova-compute[75071]:     </disk>
Nov 29 13:48:37 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:48:37 user nova-compute[75071]:       <mac address="fa:16:3e:70:c7:e5"/>
Nov 29 13:48:37 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:48:37 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:48:37 user nova-compute[75071]:       <target dev="tap07270a9d-85"/>
Nov 29 13:48:37 user nova-compute[75071]:     </interface>
Nov 29 13:48:37 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:48:37 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/console.log" append="off"/>
Nov 29 13:48:37 user nova-compute[75071]:     </serial>
Nov 29 13:48:37 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:48:37 user nova-compute[75071]:     <video>
Nov 29 13:48:37 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:48:37 user nova-compute[75071]:     </video>
Nov 29 13:48:37 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:48:37 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:48:37 user nova-compute[75071]:     </rng>
Nov 29 13:48:37 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:48:37 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:48:37 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:48:37 user nova-compute[75071]:     </memballoon>
Nov 29 13:48:37 user nova-compute[75071]:   </devices>
Nov 29 13:48:37 user nova-compute[75071]: </domain>
Nov 29 13:48:37 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:48:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance destroyed successfully.
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:48:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] No VIF found with MAC fa:16:3e:70:c7:e5, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-828b1ddf-7e83-4b5c-949b-aaba82292f7d req-d30f17d7-3e21-4781-8ee6-4711b973ae7b service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-828b1ddf-7e83-4b5c-949b-aaba82292f7d req-d30f17d7-3e21-4781-8ee6-4711b973ae7b service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-828b1ddf-7e83-4b5c-949b-aaba82292f7d req-d30f17d7-3e21-4781-8ee6-4711b973ae7b service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-828b1ddf-7e83-4b5c-949b-aaba82292f7d req-d30f17d7-3e21-4781-8ee6-4711b973ae7b service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-828b1ddf-7e83-4b5c-949b-aaba82292f7d req-d30f17d7-3e21-4781-8ee6-4711b973ae7b service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:38 user nova-compute[75071]: WARNING nova.compute.manager [req-828b1ddf-7e83-4b5c-949b-aaba82292f7d req-d30f17d7-3e21-4781-8ee6-4711b973ae7b service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state active and task_state rescuing.
Nov 29 13:48:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:40 user nova-compute[75071]: WARNING nova.compute.manager [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state active and task_state rescuing.
Nov 29 13:48:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:48:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:48:40 user nova-compute[75071]: WARNING nova.compute.manager [req-a278a830-8d2e-4598-b2fe-cda68d449eff req-e63e6123-fbf3-4b4d-ab67-b1909136c812 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state active and task_state rescuing.
Nov 29 13:48:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-206431a4-7070-4522-9417-97b8441a4d2f tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:48:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:48:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:48:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:49:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:49:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:49:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:49:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:49:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:49:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:49:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=24.963539123535156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7efc0092-90b1-4f54-8816-8841cd207cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:49:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:49:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:49:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:49:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:49:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:49:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:49:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:49:54 user nova-compute[75071]: INFO nova.compute.claims [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Claim successful on node user
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:49:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.policy [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d8e5a0d787f48cab386649385fc591c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ab355c87254605b8d1fec5d3cd4195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:49:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Creating image(s)
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "/opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "/opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "/opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk 1073741824" returned: 0 in 0.053s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.224s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-changed-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Refreshing instance network info cache due to event network-changed-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] Acquiring lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] Acquired lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.network.neutron [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Refreshing network info cache for port e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Successfully created port: a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Cannot resize image /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Ensure instance console log exists: /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:55 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'flavor' on Instance uuid e6a72f73-2d9e-4590-9e7f-a44c143f92a0 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:49:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Ignoring supplied device name: /dev/vdb
Nov 29 13:49:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:56 user nova-compute[75071]: INFO nova.compute.manager [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Attaching volume 3e0ba020-1210-45db-8026-8ec0a2c564e0 to /dev/vdb
Nov 29 13:49:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ad2661-a9eb-4558-9d62-dbf293543393]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30ee621-d0f0-425b-9f82-ea9b81973f48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04de3ed-a212-4935-9056-de248d1ea7e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a75d507-dcc9-4fa2-936d-25dd56d43093]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Updated VIF entry in instance network info cache for port e32dcdeb-c788-4ca5-a73e-1c26ba69de0a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Updating instance_info_cache with network_info: [{"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:49:56 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[81432fbd-09e0-409b-bd25-046c782f6cb4]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Updating existing volume attachment record: 19a138c8-e063-43b4-a094-b49cf2c8838a {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b2150452-22fb-47c4-929a-3e4cfb09d2b6 req-7a402c2c-e858-4edb-97d2-b0ed6d461524 service nova] Releasing lock "refresh_cache-e6a72f73-2d9e-4590-9e7f-a44c143f92a0" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Successfully updated port: a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquired lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-changed-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Refreshing instance network info cache due to event network-changed-a544a439-ac4c-4bce-a4e3-848eac1ea994. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] Acquiring lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updating instance_info_cache with network_info: [{"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Releasing lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Instance network_info: |[{"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] Acquired lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Refreshing network info cache for port a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Start _get_guest_xml network_info=[{"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:49:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:49:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1800775069',display_name='tempest-TestStampPattern-server-1800775069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1800775069',id=49,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOH3tZJmOSo9t45XJ4FccIVh6Yx+YZnfb0OZ/MVo+tbWtXR3J3NYF8kvQ6knUHFR6nNKNTOhAGNlLa3/3SUZY+ho2i4CBsNqC/Sr+Kh5qTptw9bO2zb+ATP9TysWlHBuw==',key_name='tempest-TestStampPattern-182219166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ab355c87254605b8d1fec5d3cd4195',ramdisk_id='',reservation_id='r-i303lgyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316270195',owner_user_name='tempest-TestStampPattern-1316270195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:49:55Z,user_data=None,user_id='9d8e5a0d787f48cab386649385fc591c',uuid=5606ad5d-1151-4880-af5b-dcbdc46da257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converting VIF {"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a0:ce,bridge_name='br-int',has_traffic_filtering=True,id=a544a439-ac4c-4bce-a4e3-848eac1ea994,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa544a439-ac') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'pci_devices' on Instance uuid 5606ad5d-1151-4880-af5b-dcbdc46da257 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:49:56 user nova-compute[75071]:   <uuid>5606ad5d-1151-4880-af5b-dcbdc46da257</uuid>
Nov 29 13:49:56 user nova-compute[75071]:   <name>instance-00000031</name>
Nov 29 13:49:56 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:49:56 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:49:56 user nova-compute[75071]:   <metadata>
Nov 29 13:49:56 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:49:56 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:49:56 user nova-compute[75071]:       <nova:name>tempest-TestStampPattern-server-1800775069</nova:name>
Nov 29 13:49:56 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:49:56</nova:creationTime>
Nov 29 13:49:56 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:49:56 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:49:56 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:49:56 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:49:56 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:49:56 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:49:56 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:49:56 user nova-compute[75071]:       <nova:owner>
Nov 29 13:49:56 user nova-compute[75071]:         <nova:user uuid="9d8e5a0d787f48cab386649385fc591c">tempest-TestStampPattern-1316270195-project-member</nova:user>
Nov 29 13:49:56 user nova-compute[75071]:         <nova:project uuid="60ab355c87254605b8d1fec5d3cd4195">tempest-TestStampPattern-1316270195</nova:project>
Nov 29 13:49:56 user nova-compute[75071]:       </nova:owner>
Nov 29 13:49:56 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:49:56 user nova-compute[75071]:       <nova:ports>
Nov 29 13:49:56 user nova-compute[75071]:         <nova:port uuid="a544a439-ac4c-4bce-a4e3-848eac1ea994">
Nov 29 13:49:56 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 13:49:56 user nova-compute[75071]:         </nova:port>
Nov 29 13:49:56 user nova-compute[75071]:       </nova:ports>
Nov 29 13:49:56 user nova-compute[75071]:     </nova:instance>
Nov 29 13:49:56 user nova-compute[75071]:   </metadata>
Nov 29 13:49:56 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:49:56 user nova-compute[75071]:     <system>
Nov 29 13:49:56 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:49:56 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:49:56 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:49:56 user nova-compute[75071]:       <entry name="serial">5606ad5d-1151-4880-af5b-dcbdc46da257</entry>
Nov 29 13:49:56 user nova-compute[75071]:       <entry name="uuid">5606ad5d-1151-4880-af5b-dcbdc46da257</entry>
Nov 29 13:49:56 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:49:56 user nova-compute[75071]:     </system>
Nov 29 13:49:56 user nova-compute[75071]:   </sysinfo>
Nov 29 13:49:56 user nova-compute[75071]:   <os>
Nov 29 13:49:56 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:49:56 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:49:56 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:49:56 user nova-compute[75071]:   </os>
Nov 29 13:49:56 user nova-compute[75071]:   <features>
Nov 29 13:49:56 user nova-compute[75071]:     <acpi/>
Nov 29 13:49:56 user nova-compute[75071]:     <apic/>
Nov 29 13:49:56 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:49:56 user nova-compute[75071]:   </features>
Nov 29 13:49:56 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:49:56 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:49:56 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:49:56 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:49:56 user nova-compute[75071]:   </clock>
Nov 29 13:49:56 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:49:56 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:49:56 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:49:56 user nova-compute[75071]:   </cpu>
Nov 29 13:49:56 user nova-compute[75071]:   <devices>
Nov 29 13:49:56 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:49:56 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:49:56 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk"/>
Nov 29 13:49:56 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:49:56 user nova-compute[75071]:     </disk>
Nov 29 13:49:56 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:49:56 user nova-compute[75071]:       <mac address="fa:16:3e:36:a0:ce"/>
Nov 29 13:49:56 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:49:56 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:49:56 user nova-compute[75071]:       <target dev="tapa544a439-ac"/>
Nov 29 13:49:56 user nova-compute[75071]:     </interface>
Nov 29 13:49:56 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:49:56 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/console.log" append="off"/>
Nov 29 13:49:56 user nova-compute[75071]:     </serial>
Nov 29 13:49:56 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:49:56 user nova-compute[75071]:     <video>
Nov 29 13:49:56 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:49:56 user nova-compute[75071]:     </video>
Nov 29 13:49:56 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:49:56 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:49:56 user nova-compute[75071]:     </rng>
Nov 29 13:49:56 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:49:56 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:49:56 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:49:56 user nova-compute[75071]:     </memballoon>
Nov 29 13:49:56 user nova-compute[75071]:   </devices>
Nov 29 13:49:56 user nova-compute[75071]: </domain>
Nov 29 13:49:56 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1800775069',display_name='tempest-TestStampPattern-server-1800775069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1800775069',id=49,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOH3tZJmOSo9t45XJ4FccIVh6Yx+YZnfb0OZ/MVo+tbWtXR3J3NYF8kvQ6knUHFR6nNKNTOhAGNlLa3/3SUZY+ho2i4CBsNqC/Sr+Kh5qTptw9bO2zb+ATP9TysWlHBuw==',key_name='tempest-TestStampPattern-182219166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ab355c87254605b8d1fec5d3cd4195',ramdisk_id='',reservation_id='r-i303lgyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316270195',owner_user_name='tempest-TestStampPattern-1316270195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:49:55Z,user_data=None,user_id='9d8e5a0d787f48cab386649385fc591c',uuid=5606ad5d-1151-4880-af5b-dcbdc46da257,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converting VIF {"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:a0:ce,bridge_name='br-int',has_traffic_filtering=True,id=a544a439-ac4c-4bce-a4e3-848eac1ea994,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa544a439-ac') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG os_vif [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a0:ce,bridge_name='br-int',has_traffic_filtering=True,id=a544a439-ac4c-4bce-a4e3-848eac1ea994,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa544a439-ac') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a98a72f-5f8e-58b8-b3d5-5f4a7ad0f70d', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa544a439-ac, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa544a439-ac, col_values=(('qos', UUID('d50fa04b-90c6-4f0b-b040-7eca2e8da227')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa544a439-ac, col_values=(('external_ids', {'iface-id': 'a544a439-ac4c-4bce-a4e3-848eac1ea994', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:a0:ce', 'vm-uuid': '5606ad5d-1151-4880-af5b-dcbdc46da257'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:56 user nova-compute[75071]: INFO os_vif [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:a0:ce,bridge_name='br-int',has_traffic_filtering=True,id=a544a439-ac4c-4bce-a4e3-848eac1ea994,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa544a439-ac')
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:49:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No VIF found with MAC fa:16:3e:36:a0:ce, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:49:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updated VIF entry in instance network info cache for port a544a439-ac4c-4bce-a4e3-848eac1ea994. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:49:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updating instance_info_cache with network_info: [{"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:49:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5bce8803-4726-41b1-b308-d0e093669abf req-15150851-dc52-40eb-9e30-ce1611d39973 service nova] Releasing lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-0799f607-f5d7-4423-842a-d83febcf17c9 req-4b16e532-7292-485d-95cf-13c431515395 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0799f607-f5d7-4423-842a-d83febcf17c9 req-4b16e532-7292-485d-95cf-13c431515395 service nova] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0799f607-f5d7-4423-842a-d83febcf17c9 req-4b16e532-7292-485d-95cf-13c431515395 service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0799f607-f5d7-4423-842a-d83febcf17c9 req-4b16e532-7292-485d-95cf-13c431515395 service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-0799f607-f5d7-4423-842a-d83febcf17c9 req-4b16e532-7292-485d-95cf-13c431515395 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] No waiting events found dispatching network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:49:58 user nova-compute[75071]: WARNING nova.compute.manager [req-0799f607-f5d7-4423-842a-d83febcf17c9 req-4b16e532-7292-485d-95cf-13c431515395 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received unexpected event network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 for instance with vm_state building and task_state spawning.
Nov 29 13:49:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:49:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:50:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Instance spawned successfully.
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-fc9a0806-0851-4059-85e3-f4ae1d77cada req-6ee67667-4585-46b2-b114-0a98b0d9a007 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fc9a0806-0851-4059-85e3-f4ae1d77cada req-6ee67667-4585-46b2-b114-0a98b0d9a007 service nova] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fc9a0806-0851-4059-85e3-f4ae1d77cada req-6ee67667-4585-46b2-b114-0a98b0d9a007 service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fc9a0806-0851-4059-85e3-f4ae1d77cada req-6ee67667-4585-46b2-b114-0a98b0d9a007 service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-fc9a0806-0851-4059-85e3-f4ae1d77cada req-6ee67667-4585-46b2-b114-0a98b0d9a007 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] No waiting events found dispatching network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:50:00 user nova-compute[75071]: WARNING nova.compute.manager [req-fc9a0806-0851-4059-85e3-f4ae1d77cada req-6ee67667-4585-46b2-b114-0a98b0d9a007 service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received unexpected event network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 for instance with vm_state building and task_state spawning.
Nov 29 13:50:00 user nova-compute[75071]: INFO nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 29 13:50:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:50:00 user nova-compute[75071]: INFO nova.compute.manager [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Took 6.26 seconds to build instance.
Nov 29 13:50:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dafde06d-e812-4154-9ea4-b2e45b484083 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbWwYJDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:50:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:50:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:50:03 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c99cf-7ae6-4144-a81b-98c4437734ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:50:03 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[212e7360-65b9-4364-8560-a8ea8d155cc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0] added
Nov 29 13:50:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adcc712-afb8-4705-b6fe-e3ec1449611e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8033f4-b456-4e9d-bb51-8df1d1252011]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbWwYJDf {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbWwYJDf" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa3ed0-4e6f-42f8-af90-6b0bcd17ab85]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hbWwYJDf'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed11e9d-003b-4d32-8e73-d3fb46129821]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1236b060-ba5b-42f1-ab46-19c16cd63019]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf272eb-02d8-4f93-bcc0-eb88b4dc792c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260]
Nov 29 13:50:03 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260] successful.
Nov 29 13:50:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[959bd2c5-305f-4731-99f1-acc08cbce95e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba364ea0-6194-42a8-9e80-e34e49887194]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:03 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 (non-flash)
Nov 29 13:50:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:03 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 (non-flash)
Nov 29 13:50:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7b345-2d5d-4f41-aeab-709dd4479ee1]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:50:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbWwYJDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23633316365343237', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633316365343237', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'flavor' on Instance uuid e6a72f73-2d9e-4590-9e7f-a44c143f92a0 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:50:04 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:50:04 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:50:04 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:50:04 user nova-compute[75071]:   <serial>3e0ba020-1210-45db-8026-8ec0a2c564e0</serial>
Nov 29 13:50:04 user nova-compute[75071]: </disk>
Nov 29 13:50:04 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:50:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:50:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:50:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] No VIF found with MAC fa:16:3e:30:28:b4, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:50:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e658cf2-6c28-48fa-9249-6534c596d073 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.268s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [{"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-53f642bd-5e9a-4c9d-a866-26eeaf4c465f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:50:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:50:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:50:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=24.959766387939453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7efc0092-90b1-4f54-8816-8841cd207cae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:50:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:50:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:50:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:50:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:50:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:25 user nova-compute[75071]: INFO nova.compute.manager [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Detaching volume 3e0ba020-1210-45db-8026-8ec0a2c564e0
Nov 29 13:50:25 user nova-compute[75071]: INFO nova.virt.block_device [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Attempting to driver detach volume 3e0ba020-1210-45db-8026-8ec0a2c564e0 from mountpoint /dev/vdb
Nov 29 13:50:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Attempting to detach device vdb from instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:50:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:50:25 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:50:25 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:50:25 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:50:25 user nova-compute[75071]:   <serial>3e0ba020-1210-45db-8026-8ec0a2c564e0</serial>
Nov 29 13:50:25 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:50:25 user nova-compute[75071]: </disk>
Nov 29 13:50:25 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:50:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully detached device vdb from instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 from the persistent domain config.
Nov 29 13:50:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:50:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:50:25 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:50:25 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:50:25 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:50:25 user nova-compute[75071]:   <serial>3e0ba020-1210-45db-8026-8ec0a2c564e0</serial>
Nov 29 13:50:25 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:50:25 user nova-compute[75071]: </disk>
Nov 29 13:50:25 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:50:26 user nova-compute[75071]: INFO nova.compute.manager [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Unrescuing
Nov 29 13:50:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG nova.network.neutron [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG nova.network.neutron [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'flavor' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7df899e-b93d-4784-a94e-8c17cbc7631f req-253adf11-bab5-441b-a5a5-6b34c7d1640e service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7df899e-b93d-4784-a94e-8c17cbc7631f req-253adf11-bab5-441b-a5a5-6b34c7d1640e service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7df899e-b93d-4784-a94e-8c17cbc7631f req-253adf11-bab5-441b-a5a5-6b34c7d1640e service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b7df899e-b93d-4784-a94e-8c17cbc7631f req-253adf11-bab5-441b-a5a5-6b34c7d1640e service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-b7df899e-b93d-4784-a94e-8c17cbc7631f req-253adf11-bab5-441b-a5a5-6b34c7d1640e service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:50:26 user nova-compute[75071]: WARNING nova.compute.manager [req-b7df899e-b93d-4784-a94e-8c17cbc7631f req-253adf11-bab5-441b-a5a5-6b34c7d1640e service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:50:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance destroyed successfully.
Nov 29 13:50:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:50:28 user nova-compute[75071]: WARNING nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:50:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:50:28 user nova-compute[75071]: WARNING nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:50:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:50:28 user nova-compute[75071]: WARNING nova.compute.manager [req-3785f6e9-f66c-4ef0-a535-33a384d2eb3b req-844c5c1a-ed66-47ae-a8f2-e834f4e2de42 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state rescued and task_state unrescuing.
Nov 29 13:50:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-34cdb821-f0fd-420b-b44b-3dc038070699 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:50:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 is timed out.
Nov 29 13:50:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully detached device vdb from instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0 from the live domain config.
Nov 29 13:50:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbWwYJDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:50:45 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf6df35-9179-4105-920b-6083541fba83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:50:45 user nova-compute[75071]: No targets found.
Nov 29 13:50:45 user nova-compute[75071]: iSNS:
Nov 29 13:50:45 user nova-compute[75071]: No targets found.
Nov 29 13:50:45 user nova-compute[75071]: STATIC:
Nov 29 13:50:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0
Nov 29 13:50:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:50:45 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:50:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34
Nov 29 13:50:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:50:45 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:50:45 user nova-compute[75071]: FIRMWARE:
Nov 29 13:50:45 user nova-compute[75071]: No targets found.
Nov 29 13:50:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:50:45 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:50:45 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b52ce-08a7-46e1-9063-4758a0d0178c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8691ef5-48d4-4452-aafc-dde0778152e0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:45 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 (non-flash)
Nov 29 13:50:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:45 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 (non-flash)
Nov 29 13:50:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148410700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[660cd3bf-3e5b-4d47-a874-a3235bed04a4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b2ce0-8e19-45ab-8429-eba2a7bfe81e]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[641389a5-e844-47f9-8a93-9112c2648a3e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d54fea-3572-4ca2-bab0-66c38418f3a3]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa5410-ebe2-4c96-b9e5-79537d499c8a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[612a8da2-1e21-41fa-8698-24fdfeb80808]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260]
Nov 29 13:50:46 user nova-compute[75071]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0, portal: 172.16.0.220,3260] successful.
Nov 29 13:50:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e56c9f-63e7-4789-a001-e608ddacbfc0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== disconnect_volume: return (309ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'flavor' on Instance uuid e6a72f73-2d9e-4590-9e7f-a44c143f92a0 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989138d-b844-4754-8b55-099d34012466 tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.692s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.520s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:47 user nova-compute[75071]: INFO nova.compute.manager [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Terminating instance
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-3d0fca8b-6145-47ae-87b1-3e063e7e78de req-0fbfbf7a-f206-476d-8c5d-bf0c10f3f977 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-vif-unplugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3d0fca8b-6145-47ae-87b1-3e063e7e78de req-0fbfbf7a-f206-476d-8c5d-bf0c10f3f977 service nova] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3d0fca8b-6145-47ae-87b1-3e063e7e78de req-0fbfbf7a-f206-476d-8c5d-bf0c10f3f977 service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3d0fca8b-6145-47ae-87b1-3e063e7e78de req-0fbfbf7a-f206-476d-8c5d-bf0c10f3f977 service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-3d0fca8b-6145-47ae-87b1-3e063e7e78de req-0fbfbf7a-f206-476d-8c5d-bf0c10f3f977 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] No waiting events found dispatching network-vif-unplugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-3d0fca8b-6145-47ae-87b1-3e063e7e78de req-0fbfbf7a-f206-476d-8c5d-bf0c10f3f977 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-vif-unplugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:50:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Instance destroyed successfully.
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lazy-loading 'resources' on Instance uuid e6a72f73-2d9e-4590-9e7f-a44c143f92a0 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:48:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1904233600',display_name='tempest-VolumesSnapshotTestJSON-instance-1904233600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1904233600',id=48,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4uKBBihemPTo5/qMu3IgWuEx3T0H7gTj1JebYCqPP3k8/MEKHzp3nRsK4mkBUXI2kQebU+7Nu2+TAhbVzqIZtM8KKOn8we/w0Dcp6Kc0TomxnrqIFS4WXFvsCZ5apMVQ==',key_name='tempest-keypair-1787284326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:48:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5efc039a35ea4aecb0d420a1e2a7e2df',ramdisk_id='',reservation_id='r-b35r8itm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-815296959',owner_user_name='tempest-VolumesSnapshotTestJSON-815296959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d3f4fb84c6f4856839c72b68614ce90',uuid=e6a72f73-2d9e-4590-9e7f-a44c143f92a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converting VIF {"id": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "address": "fa:16:3e:30:28:b4", "network": {"id": "16096f4c-959a-4621-be75-fd23cdf7c583", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1353848323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5efc039a35ea4aecb0d420a1e2a7e2df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape32dcdeb-c7", "ovs_interfaceid": "e32dcdeb-c788-4ca5-a73e-1c26ba69de0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:28:b4,bridge_name='br-int',has_traffic_filtering=True,id=e32dcdeb-c788-4ca5-a73e-1c26ba69de0a,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32dcdeb-c7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_vif [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:28:b4,bridge_name='br-int',has_traffic_filtering=True,id=e32dcdeb-c788-4ca5-a73e-1c26ba69de0a,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32dcdeb-c7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape32dcdeb-c7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4ed4863-d084-49a7-9980-2363e88acfa5) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: INFO os_vif [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:28:b4,bridge_name='br-int',has_traffic_filtering=True,id=e32dcdeb-c788-4ca5-a73e-1c26ba69de0a,network=Network(16096f4c-959a-4621-be75-fd23cdf7c583),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape32dcdeb-c7')
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbWwYJDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:50:47 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e503e9ff-642d-44d7-bb3f-fe544f7eb2e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:50:47 user nova-compute[75071]: No targets found.
Nov 29 13:50:47 user nova-compute[75071]: iSNS:
Nov 29 13:50:47 user nova-compute[75071]: No targets found.
Nov 29 13:50:47 user nova-compute[75071]: STATIC:
Nov 29 13:50:47 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34
Nov 29 13:50:47 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:50:47 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:50:47 user nova-compute[75071]: FIRMWARE:
Nov 29 13:50:47 user nova-compute[75071]: No targets found.
Nov 29 13:50:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:50:47 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:50:47 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e0ba020-1210-45db-8026-8ec0a2c564e0', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a9379a-7334-4741-a0f3-827dcd6e791d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1695ab91-f087-4a1e-8a33-3023980e81f2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:50:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e3b370>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] <== disconnect_volume: return (66ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:50:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Deleting instance files /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0_del
Nov 29 13:50:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Deletion of /opt/stack/data/nova/instances/e6a72f73-2d9e-4590-9e7f-a44c143f92a0_del complete
Nov 29 13:50:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:47 user nova-compute[75071]: INFO nova.compute.manager [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 13:50:47 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:50:47 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:50:48 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:50:48 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Took 0.68 seconds to deallocate network for instance.
Nov 29 13:50:48 user nova-compute[75071]: WARNING nova.volume.cinder [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Attachment 19a138c8-e063-43b4-a094-b49cf2c8838a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 19a138c8-e063-43b4-a094-b49cf2c8838a. (HTTP 404) (Request-ID: req-77d336ad-93c3-46b3-84db-3cbf487bcb37)
Nov 29 13:50:48 user nova-compute[75071]: INFO nova.compute.manager [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Took 0.02 seconds to detach 1 volumes for instance.
Nov 29 13:50:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:48 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:50:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:50:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:48 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Deleted allocations for instance e6a72f73-2d9e-4590-9e7f-a44c143f92a0
Nov 29 13:50:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e147a6bb-1627-4760-863c-277b7f8de50f tempest-VolumesSnapshotTestJSON-815296959 tempest-VolumesSnapshotTestJSON-815296959-project-member] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-753fefd1-174a-4477-b1d6-e1235c6750f1 req-de31f2c7-23dd-4ddc-ae92-ecfea71dbae2 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-753fefd1-174a-4477-b1d6-e1235c6750f1 req-de31f2c7-23dd-4ddc-ae92-ecfea71dbae2 service nova] Acquiring lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:50:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-753fefd1-174a-4477-b1d6-e1235c6750f1 req-de31f2c7-23dd-4ddc-ae92-ecfea71dbae2 service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:50:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-753fefd1-174a-4477-b1d6-e1235c6750f1 req-de31f2c7-23dd-4ddc-ae92-ecfea71dbae2 service nova] Lock "e6a72f73-2d9e-4590-9e7f-a44c143f92a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:50:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-753fefd1-174a-4477-b1d6-e1235c6750f1 req-de31f2c7-23dd-4ddc-ae92-ecfea71dbae2 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] No waiting events found dispatching network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:50:49 user nova-compute[75071]: WARNING nova.compute.manager [req-753fefd1-174a-4477-b1d6-e1235c6750f1 req-de31f2c7-23dd-4ddc-ae92-ecfea71dbae2 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received unexpected event network-vif-plugged-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a for instance with vm_state deleted and task_state None.
Nov 29 13:50:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-753fefd1-174a-4477-b1d6-e1235c6750f1 req-de31f2c7-23dd-4ddc-ae92-ecfea71dbae2 service nova] [instance: e6a72f73-2d9e-4590-9e7f-a44c143f92a0] Received event network-vif-deleted-e32dcdeb-c788-4ca5-a73e-1c26ba69de0a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:50:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:50:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:51:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:51:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:51:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:51:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:51:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=24.95833969116211GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7efc0092-90b1-4f54-8816-8841cd207cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:51:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:51:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:51:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:51:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:51:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-changed-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:51:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Refreshing instance network info cache due to event network-changed-a544a439-ac4c-4bce-a4e3-848eac1ea994. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:51:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] Acquiring lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:51:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] Acquired lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:51:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Refreshing network info cache for port a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:51:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updated VIF entry in instance network info cache for port a544a439-ac4c-4bce-a4e3-848eac1ea994. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:51:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updating instance_info_cache with network_info: [{"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:51:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-04f175d1-b936-4745-a44e-af21d8f29283 req-8a10e90b-17a5-43db-90f4-15baca1eabba service nova] Releasing lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:51:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'flavor' on Instance uuid 5606ad5d-1151-4880-af5b-dcbdc46da257 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:51:48 user nova-compute[75071]: INFO nova.compute.manager [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Attaching volume 619998ca-084f-426f-9a98-ec7fc7d3f0c1 to /dev/vdb
Nov 29 13:51:48 user nova-compute[75071]: DEBUG os_brick.utils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a48531-5ef4-41c2-a5cf-e8b3fcf42265]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[503fd19a-be45-4ecf-bb40-9ea76a40340e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c4065-32fd-4ab2-8596-08e0a68c3b96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaa267d-9a8f-4c26-a67f-5449376d435d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:51:48 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:51:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b46106-ddf7-406e-87f5-320c55f75b08]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG os_brick.utils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:51:48 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updating existing volume attachment record: fa1f18ff-a142-4f24-ad44-099e60fe7ea1 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:51:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAxIfaTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:51:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:51:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:51:55 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c9a8a9-b2a3-4aad-bd8b-92d0a219d963]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:51:55 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eed34e-0f69-4063-8ec8-8135be76d27b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1] added
Nov 29 13:51:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa572a60-864f-4950-838f-1299158431be]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b6c983-0c98-41b2-83bf-a779983d208b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAxIfaTR {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAxIfaTR" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bffb40-f45f-474b-86f1-44e9df72d5c2]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eAxIfaTR'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8609f51-83ac-4a7f-a63f-91bba08befc1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6a0894-c328-416d-9280-0d67d69c60aa]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:51:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:51:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c0a184-57e0-4a1c-a48d-cc5167502915]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260]
Nov 29 13:51:55 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260] successful.
Nov 29 13:51:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9401fb6-b06e-4093-99e6-152fd35bf2c6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b061ee7e-9b97-454b-b6ba-fe505d893eb2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:51:56 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 (non-flash)
Nov 29 13:51:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:51:56 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 (non-flash)
Nov 29 13:51:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[728e2c75-9ede-44f7-8202-805511ebc782]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:51:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAxIfaTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26564366235393135', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564366235393135', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'flavor' on Instance uuid 5606ad5d-1151-4880-af5b-dcbdc46da257 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:51:57 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:51:57 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:51:57 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:51:57 user nova-compute[75071]:   <serial>619998ca-084f-426f-9a98-ec7fc7d3f0c1</serial>
Nov 29 13:51:57 user nova-compute[75071]: </disk>
Nov 29 13:51:57 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No VIF found with MAC fa:16:3e:36:a0:ce, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c85e3e77-adbf-4c4f-a4ab-10a9ba06ae0f tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.250s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:51:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:51:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:51:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:51:59 user nova-compute[75071]: INFO nova.compute.manager [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Detaching volume 619998ca-084f-426f-9a98-ec7fc7d3f0c1
Nov 29 13:51:59 user nova-compute[75071]: INFO nova.virt.block_device [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Attempting to driver detach volume 619998ca-084f-426f-9a98-ec7fc7d3f0c1 from mountpoint /dev/vdb
Nov 29 13:51:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Attempting to detach device vdb from instance 5606ad5d-1151-4880-af5b-dcbdc46da257 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:51:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:51:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:51:59 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:51:59 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:51:59 user nova-compute[75071]:   <serial>619998ca-084f-426f-9a98-ec7fc7d3f0c1</serial>
Nov 29 13:51:59 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:51:59 user nova-compute[75071]: </disk>
Nov 29 13:51:59 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:51:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully detached device vdb from instance 5606ad5d-1151-4880-af5b-dcbdc46da257 from the persistent domain config.
Nov 29 13:51:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5606ad5d-1151-4880-af5b-dcbdc46da257 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:51:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:51:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:51:59 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:51:59 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:51:59 user nova-compute[75071]:   <serial>619998ca-084f-426f-9a98-ec7fc7d3f0c1</serial>
Nov 29 13:51:59 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:51:59 user nova-compute[75071]: </disk>
Nov 29 13:51:59 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:52:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5606ad5d-1151-4880-af5b-dcbdc46da257 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:52:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:52:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:52:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:52:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 13:52:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:52:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8642MB free_disk=24.948013305664062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7efc0092-90b1-4f54-8816-8841cd207cae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:52:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:52:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing instance network info cache due to event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:52:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:52:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:52:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing network info cache for port 07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:52:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updated VIF entry in instance network info cache for port 07270a9d-85f9-4893-a199-2ade15b5b1ce. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:52:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:52:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fa4a111e-3b9d-477b-89c2-0a91571fb65f req-24715eff-6833-40b8-aef5-980780d864e2 service nova] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:52:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:19 user nova-compute[75071]: INFO nova.compute.manager [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Detaching volume 3244650a-1fe5-40a0-8d81-7c7851cf2f34
Nov 29 13:52:19 user nova-compute[75071]: INFO nova.virt.block_device [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Attempting to driver detach volume 3244650a-1fe5-40a0-8d81-7c7851cf2f34 from mountpoint /dev/vdb
Nov 29 13:52:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Attempting to detach device vdb from instance 7efc0092-90b1-4f54-8816-8841cd207cae from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:52:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:52:19 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:52:19 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:52:19 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:52:19 user nova-compute[75071]:   <serial>3244650a-1fe5-40a0-8d81-7c7851cf2f34</serial>
Nov 29 13:52:19 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:52:19 user nova-compute[75071]: </disk>
Nov 29 13:52:19 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:52:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully detached device vdb from instance 7efc0092-90b1-4f54-8816-8841cd207cae from the persistent domain config.
Nov 29 13:52:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7efc0092-90b1-4f54-8816-8841cd207cae from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:52:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:52:19 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:52:19 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:52:19 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:52:19 user nova-compute[75071]:   <serial>3244650a-1fe5-40a0-8d81-7c7851cf2f34</serial>
Nov 29 13:52:19 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:52:19 user nova-compute[75071]: </disk>
Nov 29 13:52:19 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:52:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:52:20 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5606ad5d-1151-4880-af5b-dcbdc46da257 is timed out.
Nov 29 13:52:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully detached device vdb from instance 5606ad5d-1151-4880-af5b-dcbdc46da257 from the live domain config.
Nov 29 13:52:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAxIfaTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:52:20 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cc5405-1638-485b-bc87-5493ee2e6052]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:52:20 user nova-compute[75071]: No targets found.
Nov 29 13:52:20 user nova-compute[75071]: iSNS:
Nov 29 13:52:20 user nova-compute[75071]: No targets found.
Nov 29 13:52:20 user nova-compute[75071]: STATIC:
Nov 29 13:52:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34
Nov 29 13:52:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:52:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:52:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1
Nov 29 13:52:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:52:20 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:52:20 user nova-compute[75071]: FIRMWARE:
Nov 29 13:52:20 user nova-compute[75071]: No targets found.
Nov 29 13:52:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:52:20 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:52:20 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[992626c1-f57d-4fbe-9813-64299487a223]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe1273-6949-43d1-9fa4-2a7b9a9e7670]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:52:20 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 (non-flash)
Nov 29 13:52:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:52:20 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 (non-flash)
Nov 29 13:52:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124e19630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dc66f4-76c2-4ba2-b6d6-cb479cf9a3f4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c8545-6b1b-4d69-92b9-7fdb604942ee]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15286e-841d-4e73-9821-abf27d312f93]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing instance network info cache due to event network-changed-07270a9d-85f9-4893-a199-2ade15b5b1ce. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] Acquiring lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] Acquired lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Refreshing network info cache for port 07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9282e9bb-b324-4380-b08d-64d4783bc365]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b147990-61ee-4edf-b658-4907e1a0548d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5320c8b-d6ed-41ee-874e-11d0b520914f]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260]
Nov 29 13:52:20 user nova-compute[75071]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1, portal: 172.16.0.220,3260] successful.
Nov 29 13:52:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:619998ca-084f-426f-9a98-ec7fc7d3f0c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.075s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[633737a0-8135-4862-86f8-70cc9dd5684a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] <== disconnect_volume: return (360ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:52:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:52:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updated VIF entry in instance network info cache for port 07270a9d-85f9-4893-a199-2ade15b5b1ce. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:52:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [{"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:52:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de2bce63-75d7-48ff-b790-9fdc3ad56509 req-1dd0a3d2-a0b4-48a8-8ab1-f5056caf40f9 service nova] Releasing lock "refresh_cache-7efc0092-90b1-4f54-8816-8841cd207cae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:52:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'flavor' on Instance uuid 5606ad5d-1151-4880-af5b-dcbdc46da257 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:52:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40d6e37a-820b-4680-bd3e-569027ca2d96 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:52:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:52:38 user nova-compute[75071]: INFO nova.compute.claims [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Claim successful on node user
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:52:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.policy [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c1ab8eb652149299900db6fab0c58f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '166ae7adf5554864ba35e7c8f8788080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:52:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Creating image(s)
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "/opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "/opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "/opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk 1073741824" returned: 0 in 0.056s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Successfully created port: ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Cannot resize image /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Ensure instance console log exists: /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:39 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7efc0092-90b1-4f54-8816-8841cd207cae is timed out.
Nov 29 13:52:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully detached device vdb from instance 7efc0092-90b1-4f54-8816-8841cd207cae from the live domain config.
Nov 29 13:52:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVYZQnzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:52:39 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc9856c-48cf-4473-b103-ea69cf44a732]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:52:39 user nova-compute[75071]: No targets found.
Nov 29 13:52:39 user nova-compute[75071]: iSNS:
Nov 29 13:52:39 user nova-compute[75071]: No targets found.
Nov 29 13:52:39 user nova-compute[75071]: STATIC:
Nov 29 13:52:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34
Nov 29 13:52:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:52:39 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:52:39 user nova-compute[75071]: FIRMWARE:
Nov 29 13:52:39 user nova-compute[75071]: No targets found.
Nov 29 13:52:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:52:39 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:52:39 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b56ea-43b5-4645-bb41-33008e0fc8f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20e2219-30d3-498c-9c6f-c2e14c061e7f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:52:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 (non-flash)
Nov 29 13:52:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148316680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a761c66-781e-48f9-9ab9-b53d7ea94f07]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30876c51-66f0-4718-8d03-c24b1b61e79f]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf9e533-0672-4fa6-b169-f7b662df4701]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f73436-11ad-4bd3-955d-c4ed508b1b2d]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72914ca9-e366-4297-8112-208fd130cc97]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5ae8c-0201-4ffc-adae-caeb3612320d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260]
Nov 29 13:52:39 user nova-compute[75071]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34, portal: 172.16.0.220,3260] successful.
Nov 29 13:52:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3244650a-1fe5-40a0-8d81-7c7851cf2f34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dd8525-130c-4883-9237-d721f0055909]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] <== disconnect_volume: return (287ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:52:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Successfully updated port: ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-changed-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Refreshing instance network info cache due to event network-changed-ee8c81a5-3eaa-444f-9eee-ecce33900718. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] Acquiring lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] Acquired lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Refreshing network info cache for port ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eebede04-dcd6-4d3a-bc16-5d5abaa9e8c1 req-dc70ec70-1917-4fdd-be6a-c4a53b1988f1 service nova] Releasing lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquired lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [{"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'flavor' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Releasing lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Instance network_info: |[{"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Start _get_guest_xml network_info=[{"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:52:40 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:52:40 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1332514440',display_name='tempest-SnapshotDataIntegrityTests-server-1332514440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1332514440',id=50,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISa1Yawknc9Xf1gqj8LzprzRK+Zf6dM3QWnRYPxS0g/Iaazp2eCfy3t6jyyMeN+x8AJU0Yufaz7/00dMa29xlBXpPwmUC3lQqBwV5bd3CiAsYLp7RJ/2xnlXuNxwprMtw==',key_name='tempest-keypair-1091950787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='166ae7adf5554864ba35e7c8f8788080',ramdisk_id='',reservation_id='r-uzjcpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-360029068',owner_user_name='tempest-SnapshotDataIntegrityTests-360029068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1ab8eb652149299900db6fab0c58f7',uuid=0018886b-15a0-49fd-9e44-701584c9af07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Converting VIF {"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a7:de,bridge_name='br-int',has_traffic_filtering=True,id=ee8c81a5-3eaa-444f-9eee-ecce33900718,network=Network(54cc6fbf-08af-43a5-a73d-d9e7454ec294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee8c81a5-3e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'pci_devices' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7d17880d-6ad7-45d2-921c-2ed275f46351 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.752s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:52:40 user nova-compute[75071]:   <uuid>0018886b-15a0-49fd-9e44-701584c9af07</uuid>
Nov 29 13:52:40 user nova-compute[75071]:   <name>instance-00000032</name>
Nov 29 13:52:40 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:52:40 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:52:40 user nova-compute[75071]:   <metadata>
Nov 29 13:52:40 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:52:40 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:52:40 user nova-compute[75071]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1332514440</nova:name>
Nov 29 13:52:40 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:52:40</nova:creationTime>
Nov 29 13:52:40 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:52:40 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:52:40 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:52:40 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:52:40 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:52:40 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:52:40 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:52:40 user nova-compute[75071]:       <nova:owner>
Nov 29 13:52:40 user nova-compute[75071]:         <nova:user uuid="2c1ab8eb652149299900db6fab0c58f7">tempest-SnapshotDataIntegrityTests-360029068-project-member</nova:user>
Nov 29 13:52:40 user nova-compute[75071]:         <nova:project uuid="166ae7adf5554864ba35e7c8f8788080">tempest-SnapshotDataIntegrityTests-360029068</nova:project>
Nov 29 13:52:40 user nova-compute[75071]:       </nova:owner>
Nov 29 13:52:40 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:52:40 user nova-compute[75071]:       <nova:ports>
Nov 29 13:52:40 user nova-compute[75071]:         <nova:port uuid="ee8c81a5-3eaa-444f-9eee-ecce33900718">
Nov 29 13:52:40 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 13:52:40 user nova-compute[75071]:         </nova:port>
Nov 29 13:52:40 user nova-compute[75071]:       </nova:ports>
Nov 29 13:52:40 user nova-compute[75071]:     </nova:instance>
Nov 29 13:52:40 user nova-compute[75071]:   </metadata>
Nov 29 13:52:40 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:52:40 user nova-compute[75071]:     <system>
Nov 29 13:52:40 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:52:40 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:52:40 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:52:40 user nova-compute[75071]:       <entry name="serial">0018886b-15a0-49fd-9e44-701584c9af07</entry>
Nov 29 13:52:40 user nova-compute[75071]:       <entry name="uuid">0018886b-15a0-49fd-9e44-701584c9af07</entry>
Nov 29 13:52:40 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:52:40 user nova-compute[75071]:     </system>
Nov 29 13:52:40 user nova-compute[75071]:   </sysinfo>
Nov 29 13:52:40 user nova-compute[75071]:   <os>
Nov 29 13:52:40 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:52:40 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:52:40 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:52:40 user nova-compute[75071]:   </os>
Nov 29 13:52:40 user nova-compute[75071]:   <features>
Nov 29 13:52:40 user nova-compute[75071]:     <acpi/>
Nov 29 13:52:40 user nova-compute[75071]:     <apic/>
Nov 29 13:52:40 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:52:40 user nova-compute[75071]:   </features>
Nov 29 13:52:40 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:52:40 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:52:40 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:52:40 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:52:40 user nova-compute[75071]:   </clock>
Nov 29 13:52:40 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:52:40 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:52:40 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:52:40 user nova-compute[75071]:   </cpu>
Nov 29 13:52:40 user nova-compute[75071]:   <devices>
Nov 29 13:52:40 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:52:40 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:52:40 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk"/>
Nov 29 13:52:40 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:52:40 user nova-compute[75071]:     </disk>
Nov 29 13:52:40 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:52:40 user nova-compute[75071]:       <mac address="fa:16:3e:75:a7:de"/>
Nov 29 13:52:40 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:52:40 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:52:40 user nova-compute[75071]:       <target dev="tapee8c81a5-3e"/>
Nov 29 13:52:40 user nova-compute[75071]:     </interface>
Nov 29 13:52:40 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:52:40 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/console.log" append="off"/>
Nov 29 13:52:40 user nova-compute[75071]:     </serial>
Nov 29 13:52:40 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:52:40 user nova-compute[75071]:     <video>
Nov 29 13:52:40 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:52:40 user nova-compute[75071]:     </video>
Nov 29 13:52:40 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:52:40 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:52:40 user nova-compute[75071]:     </rng>
Nov 29 13:52:40 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:52:40 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:52:40 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:52:40 user nova-compute[75071]:     </memballoon>
Nov 29 13:52:40 user nova-compute[75071]:   </devices>
Nov 29 13:52:40 user nova-compute[75071]: </domain>
Nov 29 13:52:40 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1332514440',display_name='tempest-SnapshotDataIntegrityTests-server-1332514440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1332514440',id=50,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISa1Yawknc9Xf1gqj8LzprzRK+Zf6dM3QWnRYPxS0g/Iaazp2eCfy3t6jyyMeN+x8AJU0Yufaz7/00dMa29xlBXpPwmUC3lQqBwV5bd3CiAsYLp7RJ/2xnlXuNxwprMtw==',key_name='tempest-keypair-1091950787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='166ae7adf5554864ba35e7c8f8788080',ramdisk_id='',reservation_id='r-uzjcpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-360029068',owner_user_name='tempest-SnapshotDataIntegrityTests-360029068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1ab8eb652149299900db6fab0c58f7',uuid=0018886b-15a0-49fd-9e44-701584c9af07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Converting VIF {"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a7:de,bridge_name='br-int',has_traffic_filtering=True,id=ee8c81a5-3eaa-444f-9eee-ecce33900718,network=Network(54cc6fbf-08af-43a5-a73d-d9e7454ec294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee8c81a5-3e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG os_vif [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a7:de,bridge_name='br-int',has_traffic_filtering=True,id=ee8c81a5-3eaa-444f-9eee-ecce33900718,network=Network(54cc6fbf-08af-43a5-a73d-d9e7454ec294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee8c81a5-3e') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d942ae0-e5ac-5384-b08f-ebad31611052', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee8c81a5-3e, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee8c81a5-3e, col_values=(('qos', UUID('46d2254d-e54a-4d30-9a96-40fe625c6561')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee8c81a5-3e, col_values=(('external_ids', {'iface-id': 'ee8c81a5-3eaa-444f-9eee-ecce33900718', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a7:de', 'vm-uuid': '0018886b-15a0-49fd-9e44-701584c9af07'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:40 user nova-compute[75071]: INFO os_vif [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a7:de,bridge_name='br-int',has_traffic_filtering=True,id=ee8c81a5-3eaa-444f-9eee-ecce33900718,network=Network(54cc6fbf-08af-43a5-a73d-d9e7454ec294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee8c81a5-3e')
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:52:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No VIF found with MAC fa:16:3e:75:a7:de, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-547999d7-e8ac-4dfd-bd2e-5f1b233e9eff req-4de04a70-cb50-4cfb-a14b-1458066cada1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-547999d7-e8ac-4dfd-bd2e-5f1b233e9eff req-4de04a70-cb50-4cfb-a14b-1458066cada1 service nova] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-547999d7-e8ac-4dfd-bd2e-5f1b233e9eff req-4de04a70-cb50-4cfb-a14b-1458066cada1 service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-547999d7-e8ac-4dfd-bd2e-5f1b233e9eff req-4de04a70-cb50-4cfb-a14b-1458066cada1 service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-547999d7-e8ac-4dfd-bd2e-5f1b233e9eff req-4de04a70-cb50-4cfb-a14b-1458066cada1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] No waiting events found dispatching network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:52:42 user nova-compute[75071]: WARNING nova.compute.manager [req-547999d7-e8ac-4dfd-bd2e-5f1b233e9eff req-4de04a70-cb50-4cfb-a14b-1458066cada1 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received unexpected event network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 for instance with vm_state building and task_state spawning.
Nov 29 13:52:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:52:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Instance spawned successfully.
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:52:44 user nova-compute[75071]: INFO nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-c954f396-1e2a-409c-8944-31bf1c2e89a8 req-91d27cc3-f50c-4410-ae48-f6f5e26cba3d service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c954f396-1e2a-409c-8944-31bf1c2e89a8 req-91d27cc3-f50c-4410-ae48-f6f5e26cba3d service nova] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c954f396-1e2a-409c-8944-31bf1c2e89a8 req-91d27cc3-f50c-4410-ae48-f6f5e26cba3d service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c954f396-1e2a-409c-8944-31bf1c2e89a8 req-91d27cc3-f50c-4410-ae48-f6f5e26cba3d service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-c954f396-1e2a-409c-8944-31bf1c2e89a8 req-91d27cc3-f50c-4410-ae48-f6f5e26cba3d service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] No waiting events found dispatching network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:52:44 user nova-compute[75071]: WARNING nova.compute.manager [req-c954f396-1e2a-409c-8944-31bf1c2e89a8 req-91d27cc3-f50c-4410-ae48-f6f5e26cba3d service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received unexpected event network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 for instance with vm_state building and task_state spawning.
Nov 29 13:52:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:44 user nova-compute[75071]: INFO nova.compute.manager [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Took 6.32 seconds to build instance.
Nov 29 13:52:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-40eb9f3b-db41-49b1-ae33-1bedac6dbd2a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.418s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:52:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:52:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:52:55 user nova-compute[75071]: INFO nova.compute.manager [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] instance snapshotting
Nov 29 13:52:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Beginning live snapshot process
Nov 29 13:52:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:52:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1z4_1sjt/71c347d374ad428eb6b8247782eb56d7.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1z4_1sjt/71c347d374ad428eb6b8247782eb56d7.delta 1073741824" returned: 0 in 0.053s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 13:52:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:52:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 13:52:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 13:52:57 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:52:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1z4_1sjt/71c347d374ad428eb6b8247782eb56d7.delta /opt/stack/data/nova/instances/snapshots/tmp1z4_1sjt/71c347d374ad428eb6b8247782eb56d7 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:52:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1z4_1sjt/71c347d374ad428eb6b8247782eb56d7.delta /opt/stack/data/nova/instances/snapshots/tmp1z4_1sjt/71c347d374ad428eb6b8247782eb56d7" returned: 0 in 0.627s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:52:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Snapshot extracted, beginning image upload
Nov 29 13:52:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Snapshot image upload complete
Nov 29 13:53:00 user nova-compute[75071]: INFO nova.compute.manager [None req-3e4841a4-eed0-4444-9854-9de3b35bdb17 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Took 5.20 seconds to snapshot the instance on the hypervisor.
Nov 29 13:53:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:53:03 user nova-compute[75071]: INFO nova.compute.claims [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Claim successful on node user
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:53:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.policy [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d8e5a0d787f48cab386649385fc591c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ab355c87254605b8d1fec5d3cd4195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:53:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Creating image(s)
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "/opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "/opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "297f9950d4f332f28f0ae9c2c09947c1bea02bc5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "297f9950d4f332f28f0ae9c2c09947c1bea02bc5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Successfully created port: 494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:53:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG nova.virt.images [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] 4a491e37-60bb-4949-958e-59d445383d39 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.part /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.part /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.converted" returned: 0 in 0.954s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Successfully updated port: 494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquired lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-changed-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Refreshing instance network info cache due to event network-changed-494cc190-2545-4d9a-890c-83b61d7b1e8a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] Acquiring lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "297f9950d4f332f28f0ae9c2c09947c1bea02bc5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.463s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5 --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "297f9950d4f332f28f0ae9c2c09947c1bea02bc5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "297f9950d4f332f28f0ae9c2c09947c1bea02bc5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updating instance_info_cache with network_info: [{"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Releasing lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Instance network_info: |[{"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] Acquired lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Refreshing network info cache for port 494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5 --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5,backing_fmt=raw /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5,backing_fmt=raw /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk 1073741824" returned: 0 in 0.050s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "297f9950d4f332f28f0ae9c2c09947c1bea02bc5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Ensure instance console log exists: /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Start _get_guest_xml network_info=[{"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4e0ce0667b048956752ea7f65e05a925',container_format='bare',created_at=2023-11-29T13:52:55Z,direct_url=<?>,disk_format='qcow2',id=4a491e37-60bb-4949-958e-59d445383d39,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-409257236',owner='60ab355c87254605b8d1fec5d3cd4195',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T13:53:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '4a491e37-60bb-4949-958e-59d445383d39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:53:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:53:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4e0ce0667b048956752ea7f65e05a925',container_format='bare',created_at=2023-11-29T13:52:55Z,direct_url=<?>,disk_format='qcow2',id=4a491e37-60bb-4949-958e-59d445383d39,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-409257236',owner='60ab355c87254605b8d1fec5d3cd4195',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T13:53:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-344817439',display_name='tempest-TestStampPattern-server-344817439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-344817439',id=51,image_ref='4a491e37-60bb-4949-958e-59d445383d39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOH3tZJmOSo9t45XJ4FccIVh6Yx+YZnfb0OZ/MVo+tbWtXR3J3NYF8kvQ6knUHFR6nNKNTOhAGNlLa3/3SUZY+ho2i4CBsNqC/Sr+Kh5qTptw9bO2zb+ATP9TysWlHBuw==',key_name='tempest-TestStampPattern-182219166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ab355c87254605b8d1fec5d3cd4195',ramdisk_id='',reservation_id='r-a9v0vmtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5606ad5d-1151-4880-af5b-dcbdc46da257',image_min_disk='1',image_min_ram='0',image_owner_id='60ab355c87254605b8d1fec5d3cd4195',image_owner_project_name='tempest-TestStampPattern-1316270195',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1316270195-project-member',image_user_id='9d8e5a0d787f48cab386649385fc591c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316270195',owner_user_name='tempest-TestStampPattern-1316270195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:53:04Z,user_data=None,user_id='9d8e5a0d787f48cab386649385fc591c',uuid=b9988594-2e8e-4935-b297-0d759c87877e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converting VIF {"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1f:7d,bridge_name='br-int',has_traffic_filtering=True,id=494cc190-2545-4d9a-890c-83b61d7b1e8a,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494cc190-25') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'pci_devices' on Instance uuid b9988594-2e8e-4935-b297-0d759c87877e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:53:06 user nova-compute[75071]:   <uuid>b9988594-2e8e-4935-b297-0d759c87877e</uuid>
Nov 29 13:53:06 user nova-compute[75071]:   <name>instance-00000033</name>
Nov 29 13:53:06 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:53:06 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:53:06 user nova-compute[75071]:   <metadata>
Nov 29 13:53:06 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:53:06 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:53:06 user nova-compute[75071]:       <nova:name>tempest-TestStampPattern-server-344817439</nova:name>
Nov 29 13:53:06 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:53:06</nova:creationTime>
Nov 29 13:53:06 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:53:06 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:53:06 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:53:06 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:53:06 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:53:06 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:53:06 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:53:06 user nova-compute[75071]:       <nova:owner>
Nov 29 13:53:06 user nova-compute[75071]:         <nova:user uuid="9d8e5a0d787f48cab386649385fc591c">tempest-TestStampPattern-1316270195-project-member</nova:user>
Nov 29 13:53:06 user nova-compute[75071]:         <nova:project uuid="60ab355c87254605b8d1fec5d3cd4195">tempest-TestStampPattern-1316270195</nova:project>
Nov 29 13:53:06 user nova-compute[75071]:       </nova:owner>
Nov 29 13:53:06 user nova-compute[75071]:       <nova:root type="image" uuid="4a491e37-60bb-4949-958e-59d445383d39"/>
Nov 29 13:53:06 user nova-compute[75071]:       <nova:ports>
Nov 29 13:53:06 user nova-compute[75071]:         <nova:port uuid="494cc190-2545-4d9a-890c-83b61d7b1e8a">
Nov 29 13:53:06 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 13:53:06 user nova-compute[75071]:         </nova:port>
Nov 29 13:53:06 user nova-compute[75071]:       </nova:ports>
Nov 29 13:53:06 user nova-compute[75071]:     </nova:instance>
Nov 29 13:53:06 user nova-compute[75071]:   </metadata>
Nov 29 13:53:06 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:53:06 user nova-compute[75071]:     <system>
Nov 29 13:53:06 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:53:06 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:53:06 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:53:06 user nova-compute[75071]:       <entry name="serial">b9988594-2e8e-4935-b297-0d759c87877e</entry>
Nov 29 13:53:06 user nova-compute[75071]:       <entry name="uuid">b9988594-2e8e-4935-b297-0d759c87877e</entry>
Nov 29 13:53:06 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:53:06 user nova-compute[75071]:     </system>
Nov 29 13:53:06 user nova-compute[75071]:   </sysinfo>
Nov 29 13:53:06 user nova-compute[75071]:   <os>
Nov 29 13:53:06 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:53:06 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:53:06 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:53:06 user nova-compute[75071]:   </os>
Nov 29 13:53:06 user nova-compute[75071]:   <features>
Nov 29 13:53:06 user nova-compute[75071]:     <acpi/>
Nov 29 13:53:06 user nova-compute[75071]:     <apic/>
Nov 29 13:53:06 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:53:06 user nova-compute[75071]:   </features>
Nov 29 13:53:06 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:53:06 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:53:06 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:53:06 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:53:06 user nova-compute[75071]:   </clock>
Nov 29 13:53:06 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:53:06 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:53:06 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:53:06 user nova-compute[75071]:   </cpu>
Nov 29 13:53:06 user nova-compute[75071]:   <devices>
Nov 29 13:53:06 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:53:06 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:53:06 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk"/>
Nov 29 13:53:06 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:53:06 user nova-compute[75071]:     </disk>
Nov 29 13:53:06 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:53:06 user nova-compute[75071]:       <mac address="fa:16:3e:5a:1f:7d"/>
Nov 29 13:53:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:53:06 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:53:06 user nova-compute[75071]:       <target dev="tap494cc190-25"/>
Nov 29 13:53:06 user nova-compute[75071]:     </interface>
Nov 29 13:53:06 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:53:06 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/console.log" append="off"/>
Nov 29 13:53:06 user nova-compute[75071]:     </serial>
Nov 29 13:53:06 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:53:06 user nova-compute[75071]:     <video>
Nov 29 13:53:06 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:53:06 user nova-compute[75071]:     </video>
Nov 29 13:53:06 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:53:06 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:53:06 user nova-compute[75071]:     </rng>
Nov 29 13:53:06 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:53:06 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:53:06 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:53:06 user nova-compute[75071]:     </memballoon>
Nov 29 13:53:06 user nova-compute[75071]:   </devices>
Nov 29 13:53:06 user nova-compute[75071]: </domain>
Nov 29 13:53:06 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-344817439',display_name='tempest-TestStampPattern-server-344817439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-344817439',id=51,image_ref='4a491e37-60bb-4949-958e-59d445383d39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOH3tZJmOSo9t45XJ4FccIVh6Yx+YZnfb0OZ/MVo+tbWtXR3J3NYF8kvQ6knUHFR6nNKNTOhAGNlLa3/3SUZY+ho2i4CBsNqC/Sr+Kh5qTptw9bO2zb+ATP9TysWlHBuw==',key_name='tempest-TestStampPattern-182219166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ab355c87254605b8d1fec5d3cd4195',ramdisk_id='',reservation_id='r-a9v0vmtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5606ad5d-1151-4880-af5b-dcbdc46da257',image_min_disk='1',image_min_ram='0',image_owner_id='60ab355c87254605b8d1fec5d3cd4195',image_owner_project_name='tempest-TestStampPattern-1316270195',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1316270195-project-member',image_user_id='9d8e5a0d787f48cab386649385fc591c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1316270195',owner_user_name='tempest-TestStampPattern-1316270195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:53:04Z,user_data=None,user_id='9d8e5a0d787f48cab386649385fc591c',uuid=b9988594-2e8e-4935-b297-0d759c87877e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converting VIF {"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1f:7d,bridge_name='br-int',has_traffic_filtering=True,id=494cc190-2545-4d9a-890c-83b61d7b1e8a,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494cc190-25') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG os_vif [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1f:7d,bridge_name='br-int',has_traffic_filtering=True,id=494cc190-2545-4d9a-890c-83b61d7b1e8a,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494cc190-25') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '952cd5dd-27a8-5f74-a0dc-f4548a5148ef', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap494cc190-25, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap494cc190-25, col_values=(('qos', UUID('6cd4f5dd-b735-4439-a19f-11da23bfe310')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap494cc190-25, col_values=(('external_ids', {'iface-id': '494cc190-2545-4d9a-890c-83b61d7b1e8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:1f:7d', 'vm-uuid': 'b9988594-2e8e-4935-b297-0d759c87877e'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:53:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:06 user nova-compute[75071]: INFO os_vif [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:1f:7d,bridge_name='br-int',has_traffic_filtering=True,id=494cc190-2545-4d9a-890c-83b61d7b1e8a,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494cc190-25')
Nov 29 13:53:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:53:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No VIF found with MAC fa:16:3e:5a:1f:7d, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:53:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updated VIF entry in instance network info cache for port 494cc190-2545-4d9a-890c-83b61d7b1e8a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:53:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updating instance_info_cache with network_info: [{"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:53:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-503f5cf2-034a-4895-8859-ac531588785c req-cfbc9db2-31c6-4a3d-8fce-2595756ed71d service nova] Releasing lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-10bd6731-b62d-4976-a57c-74ac0df4d2c0 req-a6688462-44f5-402d-a93c-d1813f1d3e99 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-10bd6731-b62d-4976-a57c-74ac0df4d2c0 req-a6688462-44f5-402d-a93c-d1813f1d3e99 service nova] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-10bd6731-b62d-4976-a57c-74ac0df4d2c0 req-a6688462-44f5-402d-a93c-d1813f1d3e99 service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-10bd6731-b62d-4976-a57c-74ac0df4d2c0 req-a6688462-44f5-402d-a93c-d1813f1d3e99 service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-10bd6731-b62d-4976-a57c-74ac0df4d2c0 req-a6688462-44f5-402d-a93c-d1813f1d3e99 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] No waiting events found dispatching network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:08 user nova-compute[75071]: WARNING nova.compute.manager [req-10bd6731-b62d-4976-a57c-74ac0df4d2c0 req-a6688462-44f5-402d-a93c-d1813f1d3e99 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received unexpected event network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a for instance with vm_state building and task_state spawning.
Nov 29 13:53:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:09 user nova-compute[75071]: INFO nova.compute.manager [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Terminating instance
Nov 29 13:53:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Instance destroyed successfully.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'resources' on Instance uuid 7efc0092-90b1-4f54-8816-8841cd207cae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-31944472',display_name='tempest-ServerRescueNegativeTestJSON-server-31944472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-31944472',id=47,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO+dehStNLRYoHxJMGT2IRFRJppi2SPcw8bXySNBipsf/O/e/v1efkcyw0Js6kI7NwYuurloRGghH4Abhy4wkTAUwS0gQzG5x6iYhTu3mAdPCHDdB7DZyguWPpFd7Gdnw==',key_name='tempest-keypair-1355438857',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-ncqjvyoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7efc0092-90b1-4f54-8816-8841cd207cae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "address": "fa:16:3e:70:c7:e5", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07270a9d-85", "ovs_interfaceid": "07270a9d-85f9-4893-a199-2ade15b5b1ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG os_vif [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07270a9d-85, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a92788c-89e4-431c-b7e7-769814bcbf89) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:53:10 user nova-compute[75071]: INFO os_vif [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:c7:e5,bridge_name='br-int',has_traffic_filtering=True,id=07270a9d-85f9-4893-a199-2ade15b5b1ce,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07270a9d-85')
Nov 29 13:53:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Deleting instance files /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae_del
Nov 29 13:53:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Deletion of /opt/stack/data/nova/instances/7efc0092-90b1-4f54-8816-8841cd207cae_del complete
Nov 29 13:53:10 user nova-compute[75071]: INFO nova.compute.manager [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] No waiting events found dispatching network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:10 user nova-compute[75071]: WARNING nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received unexpected event network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a for instance with vm_state building and task_state spawning.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:10 user nova-compute[75071]: WARNING nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state active and task_state deleting.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:10 user nova-compute[75071]: WARNING nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state active and task_state deleting.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:10 user nova-compute[75071]: WARNING nova.compute.manager [req-08e9ebe7-1d60-46aa-92ca-4c8353812c39 req-c692e456-93cf-4869-8b1f-112d0828498c service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state active and task_state deleting.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:53:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Instance spawned successfully.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:53:10 user nova-compute[75071]: INFO nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Took 7.25 seconds to spawn the instance on the hypervisor.
Nov 29 13:53:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:53:11 user nova-compute[75071]: INFO nova.compute.manager [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Took 7.88 seconds to build instance.
Nov 29 13:53:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-def17e04-74cb-4f79-8dac-29fec9362f1a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:53:11 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Took 0.96 seconds to deallocate network for instance.
Nov 29 13:53:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-5d25d59d-88df-4cc4-abf4-c25a99acd800 req-a0ac8e8d-12f3-4d19-84bf-8de511d0d8f5 service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-deleted-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:11 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Deleted allocations for instance 7efc0092-90b1-4f54-8816-8841cd207cae
Nov 29 13:53:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a256524d-b4b3-49be-9e8c-e9590c7629ca tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7efc0092-90b1-4f54-8816-8841cd207cae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:12 user nova-compute[75071]: WARNING nova.compute.manager [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-unplugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state deleted and task_state None.
Nov 29 13:53:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] Acquiring lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] Lock "7efc0092-90b1-4f54-8816-8841cd207cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] No waiting events found dispatching network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:53:12 user nova-compute[75071]: WARNING nova.compute.manager [req-eb83ff02-8944-428b-8241-557b554fe3ab req-b0e819be-0a5a-46ea-a974-4301ee989b4f service nova] [instance: 7efc0092-90b1-4f54-8816-8841cd207cae] Received unexpected event network-vif-plugged-07270a9d-85f9-4893-a199-2ade15b5b1ce for instance with vm_state deleted and task_state None.
Nov 29 13:53:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:53:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [{"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:53:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:53:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8443MB free_disk=24.792613983154297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b9988594-2e8e-4935-b297-0d759c87877e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:53:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:53:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:53:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:53:18 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:53:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Verify base images {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Image id 4a491e37-60bb-4949-958e-59d445383d39 yields fingerprint 297f9950d4f332f28f0ae9c2c09947c1bea02bc5 {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] image 4a491e37-60bb-4949-958e-59d445383d39 at (/opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5): checking
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] image 4a491e37-60bb-4949-958e-59d445383d39 at (/opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5): image is in use {{(pid=75071) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Image id 794347ff-8cf3-49d9-8652-9f89337799af yields fingerprint 23dc25edb6296a5252fe82fa2de01118e42ba1b3 {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] image 794347ff-8cf3-49d9-8652-9f89337799af at (/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3): checking
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] image 794347ff-8cf3-49d9-8652-9f89337799af at (/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3): image is in use {{(pid=75071) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] b9988594-2e8e-4935-b297-0d759c87877e is a valid instance name {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] b9988594-2e8e-4935-b297-0d759c87877e has a disk file {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b9988594-2e8e-4935-b297-0d759c87877e is backed by 297f9950d4f332f28f0ae9c2c09947c1bea02bc5 {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce is a valid instance name {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce has a disk file {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce is backed by 23dc25edb6296a5252fe82fa2de01118e42ba1b3 {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 0018886b-15a0-49fd-9e44-701584c9af07 is a valid instance name {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 0018886b-15a0-49fd-9e44-701584c9af07 has a disk file {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 is backed by 23dc25edb6296a5252fe82fa2de01118e42ba1b3 {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 5606ad5d-1151-4880-af5b-dcbdc46da257 is a valid instance name {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 5606ad5d-1151-4880-af5b-dcbdc46da257 has a disk file {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 is backed by 23dc25edb6296a5252fe82fa2de01118e42ba1b3 {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 53f642bd-5e9a-4c9d-a866-26eeaf4c465f is a valid instance name {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] 53f642bd-5e9a-4c9d-a866-26eeaf4c465f has a disk file {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f is backed by 23dc25edb6296a5252fe82fa2de01118e42ba1b3 {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0
Nov 29 13:53:34 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Active base files: /opt/stack/data/nova/instances/_base/297f9950d4f332f28f0ae9c2c09947c1bea02bc5 /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Removable base files: /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547 /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305 /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192 /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86 /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0 /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1bc049b227ee6e59f16cd06f1dda7e59a99be547
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d572025d0512daacab52078314a5ef34b69b5305
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d7dd3777ea1fab614b99e39b00b38189de5b192
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f74b8ea72d91aa9113a6155d2071493d35f98c9a
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c77bdfb46320cb777a250cce155f55cf181a91ea
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fd7a9b8b54cf9a500065bbf0c942db62808c6e86
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5726c0f355f8c7083d722a2658dbee3dbf53b0c0
Nov 29 13:53:34 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e71d1a9612c6610f0a853ad34e05bb3a18436d1b
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Verification complete {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Verify swap images {{(pid=75071) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 13:53:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Verify ephemeral images {{(pid=75071) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 13:53:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:53:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:54:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:54:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:54:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:08 user nova-compute[75071]: INFO nova.compute.manager [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Terminating instance
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-f50cfbd2-8757-4f5f-a021-6dd78c7650a1 req-1fa26c13-cb52-4c5b-8cd0-56650210a533 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-unplugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f50cfbd2-8757-4f5f-a021-6dd78c7650a1 req-1fa26c13-cb52-4c5b-8cd0-56650210a533 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f50cfbd2-8757-4f5f-a021-6dd78c7650a1 req-1fa26c13-cb52-4c5b-8cd0-56650210a533 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f50cfbd2-8757-4f5f-a021-6dd78c7650a1 req-1fa26c13-cb52-4c5b-8cd0-56650210a533 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-f50cfbd2-8757-4f5f-a021-6dd78c7650a1 req-1fa26c13-cb52-4c5b-8cd0-56650210a533 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-unplugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-f50cfbd2-8757-4f5f-a021-6dd78c7650a1 req-1fa26c13-cb52-4c5b-8cd0-56650210a533 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-unplugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:54:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Instance destroyed successfully.
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'resources' on Instance uuid 53f642bd-5e9a-4c9d-a866-26eeaf4c465f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-956692139',display_name='tempest-ServerRescueNegativeTestJSON-server-956692139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-956692139',id=39,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:39:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-82978qtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:39:55Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=53f642bd-5e9a-4c9d-a866-26eeaf4c465f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "address": "fa:16:3e:6a:be:95", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa37a280d-e3", "ovs_interfaceid": "a37a280d-e37b-419f-9a2f-42c32508a1c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG os_vif [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa37a280d-e3, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95422075-c238-491e-a9d9-416a536c2de4) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:08 user nova-compute[75071]: INFO os_vif [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:be:95,bridge_name='br-int',has_traffic_filtering=True,id=a37a280d-e37b-419f-9a2f-42c32508a1c0,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa37a280d-e3')
Nov 29 13:54:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Deleting instance files /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f_del
Nov 29 13:54:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Deletion of /opt/stack/data/nova/instances/53f642bd-5e9a-4c9d-a866-26eeaf4c465f_del complete
Nov 29 13:54:08 user nova-compute[75071]: INFO nova.compute.manager [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 29 13:54:08 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:54:08 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:54:09 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:54:09 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Took 0.51 seconds to deallocate network for instance.
Nov 29 13:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-176a9559-3c1b-4ba4-810b-b86714b4bd58 req-0d4ef038-4ae8-43de-8435-86eb65ab9615 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-deleted-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:54:09 user nova-compute[75071]: INFO nova.compute.manager [req-176a9559-3c1b-4ba4-810b-b86714b4bd58 req-0d4ef038-4ae8-43de-8435-86eb65ab9615 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Neutron deleted interface a37a280d-e37b-419f-9a2f-42c32508a1c0; detaching it from the instance and deleting it from the info cache
Nov 29 13:54:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-176a9559-3c1b-4ba4-810b-b86714b4bd58 req-0d4ef038-4ae8-43de-8435-86eb65ab9615 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-176a9559-3c1b-4ba4-810b-b86714b4bd58 req-0d4ef038-4ae8-43de-8435-86eb65ab9615 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Detach interface failed, port_id=a37a280d-e37b-419f-9a2f-42c32508a1c0, reason: Instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:54:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:09 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Deleted allocations for instance 53f642bd-5e9a-4c9d-a866-26eeaf4c465f
Nov 29 13:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57433830-3ca7-4c05-8923-8cb22077a274 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.562s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-5cf2254a-0cf5-4bc1-95fc-c294cdc80a7e req-2c091c7a-b7bf-43e0-b3a4-30e132082943 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5cf2254a-0cf5-4bc1-95fc-c294cdc80a7e req-2c091c7a-b7bf-43e0-b3a4-30e132082943 service nova] Acquiring lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5cf2254a-0cf5-4bc1-95fc-c294cdc80a7e req-2c091c7a-b7bf-43e0-b3a4-30e132082943 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5cf2254a-0cf5-4bc1-95fc-c294cdc80a7e req-2c091c7a-b7bf-43e0-b3a4-30e132082943 service nova] Lock "53f642bd-5e9a-4c9d-a866-26eeaf4c465f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-5cf2254a-0cf5-4bc1-95fc-c294cdc80a7e req-2c091c7a-b7bf-43e0-b3a4-30e132082943 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] No waiting events found dispatching network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:54:10 user nova-compute[75071]: WARNING nova.compute.manager [req-5cf2254a-0cf5-4bc1-95fc-c294cdc80a7e req-2c091c7a-b7bf-43e0-b3a4-30e132082943 service nova] [instance: 53f642bd-5e9a-4c9d-a866-26eeaf4c465f] Received unexpected event network-vif-plugged-a37a280d-e37b-419f-9a2f-42c32508a1c0 for instance with vm_state deleted and task_state None.
Nov 29 13:54:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updating instance_info_cache with network_info: [{"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:54:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=24.818843841552734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b9988594-2e8e-4935-b297-0d759c87877e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:54:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:54:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-changed-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Refreshing instance network info cache due to event network-changed-ee8c81a5-3eaa-444f-9eee-ecce33900718. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] Acquiring lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] Acquired lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:54:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Refreshing network info cache for port ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:54:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updated VIF entry in instance network info cache for port ee8c81a5-3eaa-444f-9eee-ecce33900718. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:54:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [{"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:54:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7bf2b8da-48b6-487d-aed6-9f5ce9621418 req-445530cf-1cf5-4388-a059-87e137d9487f service nova] Releasing lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:54:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:30 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:33 user nova-compute[75071]: INFO nova.compute.manager [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attaching volume 422f4ad1-ebf9-42bb-9b30-4f05addb44ee to /dev/vdb
Nov 29 13:54:33 user nova-compute[75071]: DEBUG os_brick.utils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7721cf-a558-49d7-9295-5c0c477a1b72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8c09f2-f804-462d-868a-789bcf9484d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74550527-97b4-4649-8477-8b4ea73c9c66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a68641-5b3c-4543-97b5-b46b985b7777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:54:33 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:54:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73352a5-5586-458b-a27c-6019a8e0832b]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG os_brick.utils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating existing volume attachment record: d46922cb-7366-4753-b2c8-93db51c990f5 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:54:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXQucGvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:54:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:54:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:54:40 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[160dab6b-a47e-4aee-a2c1-e310a51bb1c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:54:40 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e7ca37-c371-41f6-ac01-144523d3273c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee] added
Nov 29 13:54:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede9e61-2070-41de-ad07-276ae5f1aea4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6556ed-3103-42f3-8a10-3644fbd4889e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXQucGvY {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXQucGvY" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd08aa2-21b3-4bb9-85fd-632838163de3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXQucGvY'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63ab7db-132e-4d61-b10c-8cc1d015dfd3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a771218c-5e68-4eb8-aee7-e7f9f67e5642]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:54:40 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:54:40 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:54:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:54:40 user nova-compute[75071]: 
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[756609da-7cf0-4a44-a68d-efd4b53dcb12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260]
Nov 29 13:54:40 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260] successful.
Nov 29 13:54:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8db11-852a-4ff4-8d19-ac9b0cafa11d]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660d7eb-362e-4923-aa05-667b50d11ca9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:54:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:54:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a19047c-171b-4d99-aa7a-d215ef03ad52]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:54:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXQucGvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:54:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:54:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23636643631323562', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:54:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636643631323562', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:54:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:54:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:54:42 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:54:42 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:54:42 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:54:42 user nova-compute[75071]:   <serial>422f4ad1-ebf9-42bb-9b30-4f05addb44ee</serial>
Nov 29 13:54:42 user nova-compute[75071]: </disk>
Nov 29 13:54:42 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:54:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:54:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:54:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No VIF found with MAC fa:16:3e:75:a7:de, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:54:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-183f7518-93e6-48c2-9d8f-063dc62d1525 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.024s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-changed-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:54:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Refreshing instance network info cache due to event network-changed-494cc190-2545-4d9a-890c-83b61d7b1e8a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:54:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] Acquiring lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:54:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] Acquired lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:54:54 user nova-compute[75071]: DEBUG nova.network.neutron [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Refreshing network info cache for port 494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:54:55 user nova-compute[75071]: DEBUG nova.network.neutron [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updated VIF entry in instance network info cache for port 494cc190-2545-4d9a-890c-83b61d7b1e8a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:54:55 user nova-compute[75071]: DEBUG nova.network.neutron [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updating instance_info_cache with network_info: [{"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:54:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b91a801e-fedb-422a-a86c-401ff141798f req-c7ecd6d9-f9c6-4fbe-aa16-0e2d2c3f8cb4 service nova] Releasing lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'flavor' on Instance uuid b9988594-2e8e-4935-b297-0d759c87877e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:56 user nova-compute[75071]: INFO nova.compute.manager [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Attaching volume 8fcf3611-b327-47bc-b0c6-daa151ecbea1 to /dev/vdb
Nov 29 13:54:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cb465-8f57-429f-9f84-17f35f0e9c37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1345e1-291e-4084-b5fd-2a0e81bcdeed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13dff77-34ed-41eb-bdcd-245326567760]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc4d7d2-6fb0-485d-adbe-7ebef246b6e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:54:56 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:54:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c566e90-0efe-4610-b1f7-879ae4799d54]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:54:56 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updating existing volume attachment record: c95dde8c-4305-4c4b-8312-0a0b31a93db4 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:58 user nova-compute[75071]: INFO nova.compute.manager [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Detaching volume 422f4ad1-ebf9-42bb-9b30-4f05addb44ee
Nov 29 13:54:58 user nova-compute[75071]: INFO nova.virt.block_device [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attempting to driver detach volume 422f4ad1-ebf9-42bb-9b30-4f05addb44ee from mountpoint /dev/vdb
Nov 29 13:54:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Attempting to detach device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:54:58 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:54:58 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:54:58 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:54:58 user nova-compute[75071]:   <serial>422f4ad1-ebf9-42bb-9b30-4f05addb44ee</serial>
Nov 29 13:54:58 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:54:58 user nova-compute[75071]: </disk>
Nov 29 13:54:58 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:54:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config.
Nov 29 13:54:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:54:58 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:54:58 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:54:58 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:54:58 user nova-compute[75071]:   <serial>422f4ad1-ebf9-42bb-9b30-4f05addb44ee</serial>
Nov 29 13:54:58 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:54:58 user nova-compute[75071]: </disk>
Nov 29 13:54:58 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:58 user nova-compute[75071]: INFO nova.compute.manager [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Terminating instance
Nov 29 13:54:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-b4d9734f-a1d7-4a23-a30a-ff39e5cbed6a req-75912eb9-745b-4f2a-8fd2-1ef338198df1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b4d9734f-a1d7-4a23-a30a-ff39e5cbed6a req-75912eb9-745b-4f2a-8fd2-1ef338198df1 service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b4d9734f-a1d7-4a23-a30a-ff39e5cbed6a req-75912eb9-745b-4f2a-8fd2-1ef338198df1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b4d9734f-a1d7-4a23-a30a-ff39e5cbed6a req-75912eb9-745b-4f2a-8fd2-1ef338198df1 service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-b4d9734f-a1d7-4a23-a30a-ff39e5cbed6a req-75912eb9-745b-4f2a-8fd2-1ef338198df1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-b4d9734f-a1d7-4a23-a30a-ff39e5cbed6a req-75912eb9-745b-4f2a-8fd2-1ef338198df1 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-unplugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Instance destroyed successfully.
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lazy-loading 'resources' on Instance uuid 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2062987681',display_name='tempest-ServerRescueNegativeTestJSON-server-2062987681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2062987681',id=38,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:42:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02fdf8ccfd7b4320b9422fd1145705cb',ramdisk_id='',reservation_id='r-oj39li58',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-904604817',owner_user_name='tempest-ServerRescueNegativeTestJSON-904604817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:44:41Z,user_data=None,user_id='2457f7d6a4f64d2d94a542d73403814f',uuid=7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converting VIF {"id": "251cf287-d635-477f-bc23-f0d8e8f1483d", "address": "fa:16:3e:6d:d0:f9", "network": {"id": "00d7b684-8481-4f24-a085-b9b53dc57a57", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1921081087-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02fdf8ccfd7b4320b9422fd1145705cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251cf287-d6", "ovs_interfaceid": "251cf287-d635-477f-bc23-f0d8e8f1483d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG os_vif [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap251cf287-d6, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef25ac7f-e286-4674-bd7e-f2786bb5cb60) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:54:59 user nova-compute[75071]: INFO os_vif [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:d0:f9,bridge_name='br-int',has_traffic_filtering=True,id=251cf287-d635-477f-bc23-f0d8e8f1483d,network=Network(00d7b684-8481-4f24-a085-b9b53dc57a57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251cf287-d6')
Nov 29 13:54:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Deleting instance files /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce_del
Nov 29 13:54:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Deletion of /opt/stack/data/nova/instances/7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce_del complete
Nov 29 13:54:59 user nova-compute[75071]: INFO nova.compute.manager [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 13:54:59 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:54:59 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:55:00 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:55:00 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Took 0.56 seconds to deallocate network for instance.
Nov 29 13:55:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-ea87f6f6-3ba0-476a-b512-1d64464100ae req-5b9fc4c0-cf05-48a6-9943-05460384da62 service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-deleted-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:55:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:00 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:55:00 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:55:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:00 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Deleted allocations for instance 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce
Nov 29 13:55:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c5d7981-a0f2-46ed-ae5c-1a06138b9801 tempest-ServerRescueNegativeTestJSON-904604817 tempest-ServerRescueNegativeTestJSON-904604817-project-member] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-668e1303-d1fe-4347-a4b4-3a36321a9412 req-7effb431-776b-4fbc-817b-ce154e3fe85b service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:55:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-668e1303-d1fe-4347-a4b4-3a36321a9412 req-7effb431-776b-4fbc-817b-ce154e3fe85b service nova] Acquiring lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-668e1303-d1fe-4347-a4b4-3a36321a9412 req-7effb431-776b-4fbc-817b-ce154e3fe85b service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-668e1303-d1fe-4347-a4b4-3a36321a9412 req-7effb431-776b-4fbc-817b-ce154e3fe85b service nova] Lock "7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-668e1303-d1fe-4347-a4b4-3a36321a9412 req-7effb431-776b-4fbc-817b-ce154e3fe85b service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] No waiting events found dispatching network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:55:01 user nova-compute[75071]: WARNING nova.compute.manager [req-668e1303-d1fe-4347-a4b4-3a36321a9412 req-7effb431-776b-4fbc-817b-ce154e3fe85b service nova] [instance: 7ffa7d5d-9ad7-4e3e-aa98-2f59e97801ce] Received unexpected event network-vif-plugged-251cf287-d635-477f-bc23-f0d8e8f1483d for instance with vm_state deleted and task_state None.
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 5606ad5d-1151-4880-af5b-dcbdc46da257 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid b9988594-2e8e-4935-b297-0d759c87877e {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZdochEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:55:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:55:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:55:03 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c283b-cf18-44c0-9f6c-009aa1396286]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:55:03 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae058a38-9db1-44c2-9170-a4bae06847e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1] added
Nov 29 13:55:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ea24c-4725-4c19-b3e1-6b1a86e053a9]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f68bc7e-1fa2-4d39-b6ff-ac43b3d8fde4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZdochEj {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sZdochEj" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df507a59-c28e-4b9b-b109-c0fd33e10b54]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sZdochEj'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0707bf-351d-4d10-83bc-94ca6ee2550e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763ff48-9996-4153-b173-922e17d111ce]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:55:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:55:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:55:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5f8a6-9a7f-4221-abd8-9bc5812b8817]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260]
Nov 29 13:55:04 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260] successful.
Nov 29 13:55:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55994c4-e596-4ff0-9c06-ab0b7674bcb3]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8c9c63-91d3-4425-91a2-890ef9fb9bb0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:55:04 user nova-compute[75071]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)
Nov 29 13:55:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:55:04 user nova-compute[75071]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)
Nov 29 13:55:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbe5434-8331-4057-b14f-9b6bcdd69863]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZdochEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23165633630393661', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165633630393661', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'flavor' on Instance uuid b9988594-2e8e-4935-b297-0d759c87877e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:55:05 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:55:05 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:55:05 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:55:05 user nova-compute[75071]:   <serial>8fcf3611-b327-47bc-b0c6-daa151ecbea1</serial>
Nov 29 13:55:05 user nova-compute[75071]: </disk>
Nov 29 13:55:05 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] No VIF found with MAC fa:16:3e:5a:1f:7d, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7f3f0936-ef8d-4591-a0db-afba991ee58a tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.104s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "b9988594-2e8e-4935-b297-0d759c87877e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.925s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "b9988594-2e8e-4935-b297-0d759c87877e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:07 user nova-compute[75071]: INFO nova.compute.manager [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Detaching volume 8fcf3611-b327-47bc-b0c6-daa151ecbea1
Nov 29 13:55:07 user nova-compute[75071]: INFO nova.virt.block_device [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Attempting to driver detach volume 8fcf3611-b327-47bc-b0c6-daa151ecbea1 from mountpoint /dev/vdb
Nov 29 13:55:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Attempting to detach device vdb from instance b9988594-2e8e-4935-b297-0d759c87877e from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:55:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:55:07 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:55:07 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:55:07 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:55:07 user nova-compute[75071]:   <serial>8fcf3611-b327-47bc-b0c6-daa151ecbea1</serial>
Nov 29 13:55:07 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:55:07 user nova-compute[75071]: </disk>
Nov 29 13:55:07 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:55:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully detached device vdb from instance b9988594-2e8e-4935-b297-0d759c87877e from the persistent domain config.
Nov 29 13:55:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9988594-2e8e-4935-b297-0d759c87877e from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:55:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:55:07 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:55:07 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Nov 29 13:55:07 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:55:07 user nova-compute[75071]:   <serial>8fcf3611-b327-47bc-b0c6-daa151ecbea1</serial>
Nov 29 13:55:07 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:55:07 user nova-compute[75071]: </disk>
Nov 29 13:55:07 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:55:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9988594-2e8e-4935-b297-0d759c87877e {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:55:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [{"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:55:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=24.845088958740234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance b9988594-2e8e-4935-b297-0d759c87877e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:18 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 is timed out.
Nov 29 13:55:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:55:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config.
Nov 29 13:55:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXQucGvY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:55:18 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:55:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65d24e9-eb00-425b-b6cd-a4b1adc0cd5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:55:18 user nova-compute[75071]: No targets found.
Nov 29 13:55:18 user nova-compute[75071]: iSNS:
Nov 29 13:55:18 user nova-compute[75071]: No targets found.
Nov 29 13:55:18 user nova-compute[75071]: STATIC:
Nov 29 13:55:18 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1
Nov 29 13:55:18 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:55:18 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:55:18 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee
Nov 29 13:55:18 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:55:18 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:55:18 user nova-compute[75071]: FIRMWARE:
Nov 29 13:55:18 user nova-compute[75071]: No targets found.
Nov 29 13:55:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:55:18 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:55:18 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:55:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5efe182-ec68-4533-8161-5897ce9b4008]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbd53d-eb3e-4d5d-b9e0-d808140ff6a0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:55:19 user nova-compute[75071]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)
Nov 29 13:55:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee (non-flash)
Nov 29 13:55:19 user nova-compute[75071]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)
Nov 29 13:55:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124db8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab1bf9d-6179-49e2-b136-de7b3b07888f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9426e23-7348-4e9a-a5cf-b11e905196fe]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc89207-c193-4c65-b2dd-4bad7a7a2545]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98100535-f309-458e-80a9-ee9ff00b02bb]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[945376d2-301c-408a-b188-5a08d2040c30]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fcdc4e-2df7-4cf8-99b2-f35de43dab82]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260]
Nov 29 13:55:19 user nova-compute[75071]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee, portal: 172.16.0.220,3260] successful.
Nov 29 13:55:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422f4ad1-ebf9-42bb-9b30-4f05addb44ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34207588-e25d-4db0-8862-7871bb4e9c1a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== disconnect_volume: return (285ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:55:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:55:20 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:55:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ad8a6f9-fdfe-45be-a0e0-0fad9b6abaf4 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.695s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.347s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:55:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b9988594-2e8e-4935-b297-0d759c87877e is timed out.
Nov 29 13:55:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully detached device vdb from instance b9988594-2e8e-4935-b297-0d759c87877e from the live domain config.
Nov 29 13:55:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sZdochEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:55:27 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eae154b-dc47-4ac4-9e5b-e856ac4bd8a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:55:27 user nova-compute[75071]: No targets found.
Nov 29 13:55:27 user nova-compute[75071]: iSNS:
Nov 29 13:55:27 user nova-compute[75071]: No targets found.
Nov 29 13:55:27 user nova-compute[75071]: STATIC:
Nov 29 13:55:27 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1
Nov 29 13:55:27 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:55:27 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:55:27 user nova-compute[75071]: FIRMWARE:
Nov 29 13:55:27 user nova-compute[75071]: No targets found.
Nov 29 13:55:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:55:27 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:55:27 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1504ba93-a795-47b2-966d-496415bb4d46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef0cb77-6496-4d35-abfe-743f9ca6394b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)
Nov 29 13:55:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 (non-flash)
Nov 29 13:55:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124db8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[681053b3-89a1-4de1-b83d-61029e3a046e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8174454-5a7a-457b-8d46-e7636cbb7278]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[323006a6-838c-463c-8f62-a84b8d9aa776]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[908c17e7-7c65-4fdd-a991-ec15f9ea71bc]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f328ab-6af2-4ad3-884f-1d4d3c24c376]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ab51d-d36a-4cdc-86dc-da8e79903fb7]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260]
Nov 29 13:55:27 user nova-compute[75071]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1, portal: 172.16.0.220,3260] successful.
Nov 29 13:55:27 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fcf3611-b327-47bc-b0c6-daa151ecbea1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37acbace-48c9-45a9-91c1-114a9b6b5a86]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] <== disconnect_volume: return (264ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'flavor' on Instance uuid b9988594-2e8e-4935-b297-0d759c87877e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:55:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-612dab98-17cb-4cf8-a377-c2146c234628 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.572s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:55:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:55:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:55:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:51 user nova-compute[75071]: INFO nova.compute.manager [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attaching volume d95f5b74-49eb-4c68-887d-d0ecc48d14a5 to /dev/vdb
Nov 29 13:55:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9929978-0661-4570-b2aa-31335d6a770c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e25fe-4532-4833-8a61-bc30e1896808]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a811edc-2f16-43a7-9fbd-c8a5216aa124]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c22f5c1-68ab-4187-ad5f-141a87920b4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:55:51 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:55:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[002b06c5-e943-484c-ad1c-de673c3c4af0]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:55:51 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating existing volume attachment record: 4fbabd3f-2243-4258-94ba-201a0a8d1b04 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:55:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-changed-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:55:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Refreshing instance network info cache due to event network-changed-494cc190-2545-4d9a-890c-83b61d7b1e8a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:55:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] Acquiring lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:55:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] Acquired lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:55:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Refreshing network info cache for port 494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:58 user nova-compute[75071]: INFO nova.compute.manager [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Terminating instance
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-f909ff40-cbe7-4f80-b65b-f3c2f26df362 req-f0ba6782-6263-46ef-bfaa-fd38f42414e2 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-vif-unplugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f909ff40-cbe7-4f80-b65b-f3c2f26df362 req-f0ba6782-6263-46ef-bfaa-fd38f42414e2 service nova] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f909ff40-cbe7-4f80-b65b-f3c2f26df362 req-f0ba6782-6263-46ef-bfaa-fd38f42414e2 service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f909ff40-cbe7-4f80-b65b-f3c2f26df362 req-f0ba6782-6263-46ef-bfaa-fd38f42414e2 service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-f909ff40-cbe7-4f80-b65b-f3c2f26df362 req-f0ba6782-6263-46ef-bfaa-fd38f42414e2 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] No waiting events found dispatching network-vif-unplugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-f909ff40-cbe7-4f80-b65b-f3c2f26df362 req-f0ba6782-6263-46ef-bfaa-fd38f42414e2 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-vif-unplugged-494cc190-2545-4d9a-890c-83b61d7b1e8a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updated VIF entry in instance network info cache for port 494cc190-2545-4d9a-890c-83b61d7b1e8a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updating instance_info_cache with network_info: [{"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fbfcf0a8-ad9c-4ed6-a2b3-e74bd73b5bc3 req-7322e418-1ef9-43b0-9518-43ac5e613f10 service nova] Releasing lock "refresh_cache-b9988594-2e8e-4935-b297-0d759c87877e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Instance destroyed successfully.
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'resources' on Instance uuid b9988594-2e8e-4935-b297-0d759c87877e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-344817439',display_name='tempest-TestStampPattern-server-344817439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-344817439',id=51,image_ref='4a491e37-60bb-4949-958e-59d445383d39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOH3tZJmOSo9t45XJ4FccIVh6Yx+YZnfb0OZ/MVo+tbWtXR3J3NYF8kvQ6knUHFR6nNKNTOhAGNlLa3/3SUZY+ho2i4CBsNqC/Sr+Kh5qTptw9bO2zb+ATP9TysWlHBuw==',key_name='tempest-TestStampPattern-182219166',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ab355c87254605b8d1fec5d3cd4195',ramdisk_id='',reservation_id='r-a9v0vmtz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5606ad5d-1151-4880-af5b-dcbdc46da257',image_min_disk='1',image_min_ram='0',image_owner_id='60ab355c87254605b8d1fec5d3cd4195',image_owner_project_name='tempest-TestStampPattern-1316270195',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1316270195-project-member',image_user_id='9d8e5a0d787f48cab386649385fc591c',owner_project_name='tempest-TestStampPattern-1316270195',owner_user_name='tempest-TestStampPattern-1316270195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:53:11Z,user_data=None,user_id='9d8e5a0d787f48cab386649385fc591c',uuid=b9988594-2e8e-4935-b297-0d759c87877e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converting VIF {"id": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "address": "fa:16:3e:5a:1f:7d", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494cc190-25", "ovs_interfaceid": "494cc190-2545-4d9a-890c-83b61d7b1e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:1f:7d,bridge_name='br-int',has_traffic_filtering=True,id=494cc190-2545-4d9a-890c-83b61d7b1e8a,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494cc190-25') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG os_vif [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:1f:7d,bridge_name='br-int',has_traffic_filtering=True,id=494cc190-2545-4d9a-890c-83b61d7b1e8a,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494cc190-25') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap494cc190-25, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cd4f5dd-b735-4439-a19f-11da23bfe310) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:55:58 user nova-compute[75071]: INFO os_vif [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:1f:7d,bridge_name='br-int',has_traffic_filtering=True,id=494cc190-2545-4d9a-890c-83b61d7b1e8a,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494cc190-25')
Nov 29 13:55:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Deleting instance files /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e_del
Nov 29 13:55:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Deletion of /opt/stack/data/nova/instances/b9988594-2e8e-4935-b297-0d759c87877e_del complete
Nov 29 13:55:58 user nova-compute[75071]: INFO nova.compute.manager [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 13:55:58 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:55:58 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b9988594-2e8e-4935-b297-0d759c87877e] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUqmVEfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:55:59 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:55:59 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:55:59 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9707a10-38d1-4b75-bf63-88c7588553b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:55:59 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746b05b-067c-49d7-b857-f8396f60abff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5] added
Nov 29 13:55:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df6b96-af14-4b8f-917b-00ae878c3f70]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5955466d-86c1-4372-893b-ee58e132ccbd]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUqmVEfK {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUqmVEfK" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db16ff6-41f2-460c-b185-90b17f09af38]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUqmVEfK'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b91642-3f15-422c-baa9-ef04fa79d4d9]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b486b74-272f-46d3-868a-8d399236256c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:55:59 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:55:59 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:55:59 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:55:59 user nova-compute[75071]: 
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b9122e-6aa4-4791-b356-d55a6f0a28be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260]
Nov 29 13:55:59 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260] successful.
Nov 29 13:55:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[489cadbb-7eb3-4657-96bc-1c4475c9d0ef]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe4f68e-eb9a-481a-8eb4-b39533094201]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 (non-flash)
Nov 29 13:55:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 (non-flash)
Nov 29 13:55:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6452e26d-deb4-499e-af39-dc76f0ae5b92]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUqmVEfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:55:59 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Took 0.54 seconds to deallocate network for instance.
Nov 29 13:55:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:59 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Deleted allocations for instance b9988594-2e8e-4935-b297-0d759c87877e
Nov 29 13:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d600df85-1b5d-43a6-9b24-fc76e01422a6 tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "b9988594-2e8e-4935-b297-0d759c87877e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.807s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:55:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-9446ecf0-8f22-4333-aec3-16399dce46e3 req-f90b485c-1287-4813-ab48-adadd9d342a8 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-vif-deleted-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23139623837303038', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139623837303038', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-2493d423-c64d-44cf-a8bf-8c0129015acb req-97810afb-54f0-4477-83aa-07114956bc60 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received event network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2493d423-c64d-44cf-a8bf-8c0129015acb req-97810afb-54f0-4477-83aa-07114956bc60 service nova] Acquiring lock "b9988594-2e8e-4935-b297-0d759c87877e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2493d423-c64d-44cf-a8bf-8c0129015acb req-97810afb-54f0-4477-83aa-07114956bc60 service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2493d423-c64d-44cf-a8bf-8c0129015acb req-97810afb-54f0-4477-83aa-07114956bc60 service nova] Lock "b9988594-2e8e-4935-b297-0d759c87877e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-2493d423-c64d-44cf-a8bf-8c0129015acb req-97810afb-54f0-4477-83aa-07114956bc60 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] No waiting events found dispatching network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:56:00 user nova-compute[75071]: WARNING nova.compute.manager [req-2493d423-c64d-44cf-a8bf-8c0129015acb req-97810afb-54f0-4477-83aa-07114956bc60 service nova] [instance: b9988594-2e8e-4935-b297-0d759c87877e] Received unexpected event network-vif-plugged-494cc190-2545-4d9a-890c-83b61d7b1e8a for instance with vm_state deleted and task_state None.
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:56:00 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:56:00 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:56:00 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:56:00 user nova-compute[75071]:   <serial>d95f5b74-49eb-4c68-887d-d0ecc48d14a5</serial>
Nov 29 13:56:00 user nova-compute[75071]: </disk>
Nov 29 13:56:00 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:56:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No VIF found with MAC fa:16:3e:75:a7:de, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:56:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c14c8b54-b69c-41d7-bf4c-80ab6d0fb2fd tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.424s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:03 user nova-compute[75071]: INFO nova.compute.manager [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Detaching volume d95f5b74-49eb-4c68-887d-d0ecc48d14a5
Nov 29 13:56:03 user nova-compute[75071]: INFO nova.virt.block_device [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attempting to driver detach volume d95f5b74-49eb-4c68-887d-d0ecc48d14a5 from mountpoint /dev/vdb
Nov 29 13:56:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Attempting to detach device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:56:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:56:03 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:56:03 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:56:03 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:56:03 user nova-compute[75071]:   <serial>d95f5b74-49eb-4c68-887d-d0ecc48d14a5</serial>
Nov 29 13:56:03 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:56:03 user nova-compute[75071]: </disk>
Nov 29 13:56:03 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:56:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config.
Nov 29 13:56:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:56:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:56:03 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:56:03 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:56:03 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:56:03 user nova-compute[75071]:   <serial>d95f5b74-49eb-4c68-887d-d0ecc48d14a5</serial>
Nov 29 13:56:03 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:56:03 user nova-compute[75071]: </disk>
Nov 29 13:56:03 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:56:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:56:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:56:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:56:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 13:56:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:56:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=24.843852996826172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 5606ad5d-1151-4880-af5b-dcbdc46da257 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:56:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 is timed out.
Nov 29 13:56:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config.
Nov 29 13:56:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUqmVEfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:56:23 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[061d5f96-2fca-431a-b7fd-e26ca3c07c84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:56:23 user nova-compute[75071]: No targets found.
Nov 29 13:56:23 user nova-compute[75071]: iSNS:
Nov 29 13:56:23 user nova-compute[75071]: No targets found.
Nov 29 13:56:23 user nova-compute[75071]: STATIC:
Nov 29 13:56:23 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5
Nov 29 13:56:23 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:56:23 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:56:23 user nova-compute[75071]: FIRMWARE:
Nov 29 13:56:23 user nova-compute[75071]: No targets found.
Nov 29 13:56:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:56:23 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:56:23 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4607e92d-30cd-4485-88f0-138985d96236]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd03487-f2b5-438a-9f6a-5f48dd4a4e7b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 (non-flash)
Nov 29 13:56:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 (non-flash)
Nov 29 13:56:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f21486ee680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52a582b-38ee-4d19-a3b6-020fe89812ab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f791f-ae7c-4a5a-b844-972c645bf9bc]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abec033-d8c7-4da2-9961-f7f3d6f18ce4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[154d4781-cdc7-465f-8600-7b359846e777]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc0236-a408-4327-8a3c-aa6710e04c92]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdae1bd2-1642-4bfa-8957-e59a1701bb71]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260]
Nov 29 13:56:24 user nova-compute[75071]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5, portal: 172.16.0.220,3260] successful.
Nov 29 13:56:24 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d95f5b74-49eb-4c68-887d-d0ecc48d14a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f6b026-7524-4f00-a817-d3c23e33e90c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== disconnect_volume: return (281ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:56:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68d81171-9135-4661-b272-0add0cf27d4e tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.596s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 13:56:35 user nova-compute[75071]: INFO nova.compute.claims [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Claim successful on node user
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 13:56:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.policy [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72463b83606a451d8f3923c5985a8033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3465ab0a0cb4ce7ae707fc0d35ef072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 13:56:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Creating image(s)
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "/opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "/opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "/opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk 1073741824" returned: 0 in 0.072s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Successfully created port: 502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Cannot resize image /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Ensure instance console log exists: /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Successfully updated port: 502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquired lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received event network-changed-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Refreshing instance network info cache due to event network-changed-502e8337-b918-462f-9c21-f146656b58b6. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] Acquiring lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Updating instance_info_cache with network_info: [{"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Releasing lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Instance network_info: |[{"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] Acquired lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Refreshing network info cache for port 502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Start _get_guest_xml network_info=[{"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 13:56:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:56:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1243200451',display_name='tempest-VolumesActionsTest-instance-1243200451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1243200451',id=52,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ab0a0cb4ce7ae707fc0d35ef072',ramdisk_id='',reservation_id='r-kcg2nvbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-364186600',owner_user_name='tempest-VolumesActionsTest-364186600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:56:36Z,user_data=None,user_id='72463b83606a451d8f3923c5985a8033',uuid=4be37a71-aee1-4a56-9144-1c4ac4e2d86e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Converting VIF {"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=502e8337-b918-462f-9c21-f146656b58b6,network=Network(cd52d7cb-438e-48e9-8729-1e826de45997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e8337-b9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lazy-loading 'pci_devices' on Instance uuid 4be37a71-aee1-4a56-9144-1c4ac4e2d86e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 13:56:37 user nova-compute[75071]:   <uuid>4be37a71-aee1-4a56-9144-1c4ac4e2d86e</uuid>
Nov 29 13:56:37 user nova-compute[75071]:   <name>instance-00000034</name>
Nov 29 13:56:37 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 13:56:37 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 13:56:37 user nova-compute[75071]:   <metadata>
Nov 29 13:56:37 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 13:56:37 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 13:56:37 user nova-compute[75071]:       <nova:name>tempest-VolumesActionsTest-instance-1243200451</nova:name>
Nov 29 13:56:37 user nova-compute[75071]:       <nova:creationTime>2023-11-29 13:56:37</nova:creationTime>
Nov 29 13:56:37 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 13:56:37 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 13:56:37 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 13:56:37 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 13:56:37 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 13:56:37 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 13:56:37 user nova-compute[75071]:       </nova:flavor>
Nov 29 13:56:37 user nova-compute[75071]:       <nova:owner>
Nov 29 13:56:37 user nova-compute[75071]:         <nova:user uuid="72463b83606a451d8f3923c5985a8033">tempest-VolumesActionsTest-364186600-project-member</nova:user>
Nov 29 13:56:37 user nova-compute[75071]:         <nova:project uuid="c3465ab0a0cb4ce7ae707fc0d35ef072">tempest-VolumesActionsTest-364186600</nova:project>
Nov 29 13:56:37 user nova-compute[75071]:       </nova:owner>
Nov 29 13:56:37 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 13:56:37 user nova-compute[75071]:       <nova:ports>
Nov 29 13:56:37 user nova-compute[75071]:         <nova:port uuid="502e8337-b918-462f-9c21-f146656b58b6">
Nov 29 13:56:37 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 13:56:37 user nova-compute[75071]:         </nova:port>
Nov 29 13:56:37 user nova-compute[75071]:       </nova:ports>
Nov 29 13:56:37 user nova-compute[75071]:     </nova:instance>
Nov 29 13:56:37 user nova-compute[75071]:   </metadata>
Nov 29 13:56:37 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 13:56:37 user nova-compute[75071]:     <system>
Nov 29 13:56:37 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 13:56:37 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 13:56:37 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 13:56:37 user nova-compute[75071]:       <entry name="serial">4be37a71-aee1-4a56-9144-1c4ac4e2d86e</entry>
Nov 29 13:56:37 user nova-compute[75071]:       <entry name="uuid">4be37a71-aee1-4a56-9144-1c4ac4e2d86e</entry>
Nov 29 13:56:37 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 13:56:37 user nova-compute[75071]:     </system>
Nov 29 13:56:37 user nova-compute[75071]:   </sysinfo>
Nov 29 13:56:37 user nova-compute[75071]:   <os>
Nov 29 13:56:37 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 13:56:37 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 13:56:37 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 13:56:37 user nova-compute[75071]:   </os>
Nov 29 13:56:37 user nova-compute[75071]:   <features>
Nov 29 13:56:37 user nova-compute[75071]:     <acpi/>
Nov 29 13:56:37 user nova-compute[75071]:     <apic/>
Nov 29 13:56:37 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 13:56:37 user nova-compute[75071]:   </features>
Nov 29 13:56:37 user nova-compute[75071]:   <clock offset="utc">
Nov 29 13:56:37 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 13:56:37 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 13:56:37 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 13:56:37 user nova-compute[75071]:   </clock>
Nov 29 13:56:37 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 13:56:37 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 13:56:37 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 13:56:37 user nova-compute[75071]:   </cpu>
Nov 29 13:56:37 user nova-compute[75071]:   <devices>
Nov 29 13:56:37 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 13:56:37 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 13:56:37 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk"/>
Nov 29 13:56:37 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 13:56:37 user nova-compute[75071]:     </disk>
Nov 29 13:56:37 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 13:56:37 user nova-compute[75071]:       <mac address="fa:16:3e:8a:a3:4c"/>
Nov 29 13:56:37 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:56:37 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 13:56:37 user nova-compute[75071]:       <target dev="tap502e8337-b9"/>
Nov 29 13:56:37 user nova-compute[75071]:     </interface>
Nov 29 13:56:37 user nova-compute[75071]:     <serial type="pty">
Nov 29 13:56:37 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/console.log" append="off"/>
Nov 29 13:56:37 user nova-compute[75071]:     </serial>
Nov 29 13:56:37 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 13:56:37 user nova-compute[75071]:     <video>
Nov 29 13:56:37 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 13:56:37 user nova-compute[75071]:     </video>
Nov 29 13:56:37 user nova-compute[75071]:     <rng model="virtio">
Nov 29 13:56:37 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 13:56:37 user nova-compute[75071]:     </rng>
Nov 29 13:56:37 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 13:56:37 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 13:56:37 user nova-compute[75071]:       <stats period="10"/>
Nov 29 13:56:37 user nova-compute[75071]:     </memballoon>
Nov 29 13:56:37 user nova-compute[75071]:   </devices>
Nov 29 13:56:37 user nova-compute[75071]: </domain>
Nov 29 13:56:37 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1243200451',display_name='tempest-VolumesActionsTest-instance-1243200451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1243200451',id=52,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3465ab0a0cb4ce7ae707fc0d35ef072',ramdisk_id='',reservation_id='r-kcg2nvbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-364186600',owner_user_name='tempest-VolumesActionsTest-364186600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T13:56:36Z,user_data=None,user_id='72463b83606a451d8f3923c5985a8033',uuid=4be37a71-aee1-4a56-9144-1c4ac4e2d86e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Converting VIF {"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=502e8337-b918-462f-9c21-f146656b58b6,network=Network(cd52d7cb-438e-48e9-8729-1e826de45997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e8337-b9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG os_vif [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=502e8337-b918-462f-9c21-f146656b58b6,network=Network(cd52d7cb-438e-48e9-8729-1e826de45997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e8337-b9') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10012ef2-ed5d-5c19-969c-dcec10c11537', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap502e8337-b9, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap502e8337-b9, col_values=(('qos', UUID('7e7365b0-3e30-4ef5-8694-7e65d276842b')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap502e8337-b9, col_values=(('external_ids', {'iface-id': '502e8337-b918-462f-9c21-f146656b58b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:a3:4c', 'vm-uuid': '4be37a71-aee1-4a56-9144-1c4ac4e2d86e'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:37 user nova-compute[75071]: INFO os_vif [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=502e8337-b918-462f-9c21-f146656b58b6,network=Network(cd52d7cb-438e-48e9-8729-1e826de45997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e8337-b9')
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] No VIF found with MAC fa:16:3e:8a:a3:4c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Updated VIF entry in instance network info cache for port 502e8337-b918-462f-9c21-f146656b58b6. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Updating instance_info_cache with network_info: [{"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ddb2afde-7c6d-4b8c-b00a-a6bc3c010acf req-e039f560-3b09-4be7-b474-722b331410df service nova] Releasing lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:56:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-b8e5ec4e-d18a-4e2b-91b2-c78acedc5b9c req-44fdcc80-0365-402f-8891-a7bba9bfef84 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received event network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b8e5ec4e-d18a-4e2b-91b2-c78acedc5b9c req-44fdcc80-0365-402f-8891-a7bba9bfef84 service nova] Acquiring lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b8e5ec4e-d18a-4e2b-91b2-c78acedc5b9c req-44fdcc80-0365-402f-8891-a7bba9bfef84 service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b8e5ec4e-d18a-4e2b-91b2-c78acedc5b9c req-44fdcc80-0365-402f-8891-a7bba9bfef84 service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-b8e5ec4e-d18a-4e2b-91b2-c78acedc5b9c req-44fdcc80-0365-402f-8891-a7bba9bfef84 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] No waiting events found dispatching network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:56:39 user nova-compute[75071]: WARNING nova.compute.manager [req-b8e5ec4e-d18a-4e2b-91b2-c78acedc5b9c req-44fdcc80-0365-402f-8891-a7bba9bfef84 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received unexpected event network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 for instance with vm_state building and task_state spawning.
Nov 29 13:56:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 13:56:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Instance spawned successfully.
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 13:56:40 user nova-compute[75071]: INFO nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 29 13:56:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 13:56:41 user nova-compute[75071]: INFO nova.compute.manager [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Took 6.08 seconds to build instance.
Nov 29 13:56:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bee4ec01-3a46-4bd3-8260-1f8770020876 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.176s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-dcf5f2e5-ff21-4b5e-8d3d-2c0777ddb891 req-6641df16-0635-4200-ba78-797eebd78d18 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received event network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dcf5f2e5-ff21-4b5e-8d3d-2c0777ddb891 req-6641df16-0635-4200-ba78-797eebd78d18 service nova] Acquiring lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dcf5f2e5-ff21-4b5e-8d3d-2c0777ddb891 req-6641df16-0635-4200-ba78-797eebd78d18 service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dcf5f2e5-ff21-4b5e-8d3d-2c0777ddb891 req-6641df16-0635-4200-ba78-797eebd78d18 service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-dcf5f2e5-ff21-4b5e-8d3d-2c0777ddb891 req-6641df16-0635-4200-ba78-797eebd78d18 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] No waiting events found dispatching network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:56:41 user nova-compute[75071]: WARNING nova.compute.manager [req-dcf5f2e5-ff21-4b5e-8d3d-2c0777ddb891 req-6641df16-0635-4200-ba78-797eebd78d18 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received unexpected event network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 for instance with vm_state active and task_state None.
Nov 29 13:56:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-changed-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Refreshing instance network info cache due to event network-changed-a544a439-ac4c-4bce-a4e3-848eac1ea994. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] Acquiring lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] Acquired lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Refreshing network info cache for port a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:56 user nova-compute[75071]: INFO nova.compute.manager [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Terminating instance
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:56 user nova-compute[75071]: INFO nova.compute.manager [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attaching volume 6325e95c-25e6-467e-8413-0dca0e38b2e1 to /dev/vdb
Nov 29 13:56:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fb2cd1-ee1e-49e4-8f2d-323b278eba6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a926f61d-679e-41ee-821f-d244cf65bc56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-da5eeb98-e2d0-414a-8789-dc478802d118 req-1ead86d6-7255-4d57-a201-57401df0d00f service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-vif-unplugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da5eeb98-e2d0-414a-8789-dc478802d118 req-1ead86d6-7255-4d57-a201-57401df0d00f service nova] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da5eeb98-e2d0-414a-8789-dc478802d118 req-1ead86d6-7255-4d57-a201-57401df0d00f service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da5eeb98-e2d0-414a-8789-dc478802d118 req-1ead86d6-7255-4d57-a201-57401df0d00f service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-da5eeb98-e2d0-414a-8789-dc478802d118 req-1ead86d6-7255-4d57-a201-57401df0d00f service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] No waiting events found dispatching network-vif-unplugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-da5eeb98-e2d0-414a-8789-dc478802d118 req-1ead86d6-7255-4d57-a201-57401df0d00f service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-vif-unplugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce4315a-e3bc-48f0-87c4-47126d3936bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e6e6fe-4a6f-4424-81d0-cb408a40fa60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:56:56 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d885d-7131-4982-820b-d52efb504e44]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating existing volume attachment record: b1271863-6d11-431f-bd33-be110fa946ce {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updated VIF entry in instance network info cache for port a544a439-ac4c-4bce-a4e3-848eac1ea994. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG nova.network.neutron [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updating instance_info_cache with network_info: [{"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:56:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-29121f3c-833c-46b0-b3cb-dbe5512c5db9 req-92f381dc-4aed-46b1-957a-04f87aad46ef service nova] Releasing lock "refresh_cache-5606ad5d-1151-4880-af5b-dcbdc46da257" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Instance destroyed successfully.
Nov 29 13:56:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lazy-loading 'resources' on Instance uuid 5606ad5d-1151-4880-af5b-dcbdc46da257 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1800775069',display_name='tempest-TestStampPattern-server-1800775069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1800775069',id=49,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOH3tZJmOSo9t45XJ4FccIVh6Yx+YZnfb0OZ/MVo+tbWtXR3J3NYF8kvQ6knUHFR6nNKNTOhAGNlLa3/3SUZY+ho2i4CBsNqC/Sr+Kh5qTptw9bO2zb+ATP9TysWlHBuw==',key_name='tempest-TestStampPattern-182219166',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:50:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ab355c87254605b8d1fec5d3cd4195',ramdisk_id='',reservation_id='r-i303lgyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1316270195',owner_user_name='tempest-TestStampPattern-1316270195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:53:01Z,user_data=None,user_id='9d8e5a0d787f48cab386649385fc591c',uuid=5606ad5d-1151-4880-af5b-dcbdc46da257,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converting VIF {"id": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "address": "fa:16:3e:36:a0:ce", "network": {"id": "19bf0758-4d58-42ae-8600-53938e5e74ff", "bridge": "br-int", "label": "tempest-TestStampPattern-1605860807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ab355c87254605b8d1fec5d3cd4195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa544a439-ac", "ovs_interfaceid": "a544a439-ac4c-4bce-a4e3-848eac1ea994", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:a0:ce,bridge_name='br-int',has_traffic_filtering=True,id=a544a439-ac4c-4bce-a4e3-848eac1ea994,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa544a439-ac') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG os_vif [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a0:ce,bridge_name='br-int',has_traffic_filtering=True,id=a544a439-ac4c-4bce-a4e3-848eac1ea994,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa544a439-ac') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa544a439-ac, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d50fa04b-90c6-4f0b-b040-7eca2e8da227) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:56:57 user nova-compute[75071]: INFO os_vif [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:a0:ce,bridge_name='br-int',has_traffic_filtering=True,id=a544a439-ac4c-4bce-a4e3-848eac1ea994,network=Network(19bf0758-4d58-42ae-8600-53938e5e74ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa544a439-ac')
Nov 29 13:56:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Deleting instance files /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257_del
Nov 29 13:56:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Deletion of /opt/stack/data/nova/instances/5606ad5d-1151-4880-af5b-dcbdc46da257_del complete
Nov 29 13:56:57 user nova-compute[75071]: INFO nova.compute.manager [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 29 13:56:57 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:56:57 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:56:58 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:56:58 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Took 0.87 seconds to deallocate network for instance.
Nov 29 13:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-c82e9657-8737-46f7-94d5-5067b38f83e6 req-d501db0d-046f-460a-ae45-97b1f91a838f service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-vif-deleted-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-c51c2bd1-7eca-4619-b454-6ab03c48da5f req-6ec03433-17bb-488b-b9d2-76cb0bb1b1dc service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received event network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c51c2bd1-7eca-4619-b454-6ab03c48da5f req-6ec03433-17bb-488b-b9d2-76cb0bb1b1dc service nova] Acquiring lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c51c2bd1-7eca-4619-b454-6ab03c48da5f req-6ec03433-17bb-488b-b9d2-76cb0bb1b1dc service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c51c2bd1-7eca-4619-b454-6ab03c48da5f req-6ec03433-17bb-488b-b9d2-76cb0bb1b1dc service nova] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-c51c2bd1-7eca-4619-b454-6ab03c48da5f req-6ec03433-17bb-488b-b9d2-76cb0bb1b1dc service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] No waiting events found dispatching network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:56:59 user nova-compute[75071]: WARNING nova.compute.manager [req-c51c2bd1-7eca-4619-b454-6ab03c48da5f req-6ec03433-17bb-488b-b9d2-76cb0bb1b1dc service nova] [instance: 5606ad5d-1151-4880-af5b-dcbdc46da257] Received unexpected event network-vif-plugged-a544a439-ac4c-4bce-a4e3-848eac1ea994 for instance with vm_state deleted and task_state None.
Nov 29 13:56:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.588s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:59 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Deleted allocations for instance 5606ad5d-1151-4880-af5b-dcbdc46da257
Nov 29 13:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e587fe33-1a61-4e55-a134-0e7f1c5ae57e tempest-TestStampPattern-1316270195 tempest-TestStampPattern-1316270195-project-member] Lock "5606ad5d-1151-4880-af5b-dcbdc46da257" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.912s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:56:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOeHSvBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:57:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:57:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:57:03 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3c472c-05bd-4114-9c6d-7e10e7256d1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:57:03 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a89fd-23f3-426c-829e-423ea136cc45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1] added
Nov 29 13:57:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae2c0b-de45-4964-b5e9-2053cf200008]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae36c9e1-abb1-4db2-a163-45e92ee7717a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOeHSvBl {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOeHSvBl" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0545c-d8f5-4bb2-856a-9ebd53f6c29c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IOeHSvBl'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc60e639-0865-421f-b9d5-7f1dc3b4450a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea8cbe-d0bf-4af5-9392-e73775f90d4b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:57:03 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:57:03 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:57:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:57:03 user nova-compute[75071]: 
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad07370f-c71c-4a3c-a916-fbd2d8a86cff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260]
Nov 29 13:57:03 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260] successful.
Nov 29 13:57:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5137e60-29f8-41c4-a700-73d8f14e906a]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac05788f-4b98-42e2-bce6-daceb1bad1cc]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 (non-flash)
Nov 29 13:57:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 (non-flash)
Nov 29 13:57:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[868481a3-ef2e-4823-a09c-6134440eda72]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOeHSvBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23532626436326361', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532626436326361', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:57:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:57:04 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:57:04 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:57:04 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:57:04 user nova-compute[75071]:   <serial>6325e95c-25e6-467e-8413-0dca0e38b2e1</serial>
Nov 29 13:57:04 user nova-compute[75071]: </disk>
Nov 29 13:57:04 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:57:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:57:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:57:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No VIF found with MAC fa:16:3e:75:a7:de, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:57:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-af1638e5-2c97-464b-b5eb-c0de4b8eee00 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.855s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:57:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:57:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:57:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:57:07 user nova-compute[75071]: INFO nova.compute.manager [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Detaching volume 6325e95c-25e6-467e-8413-0dca0e38b2e1
Nov 29 13:57:07 user nova-compute[75071]: INFO nova.virt.block_device [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attempting to driver detach volume 6325e95c-25e6-467e-8413-0dca0e38b2e1 from mountpoint /dev/vdb
Nov 29 13:57:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Attempting to detach device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:57:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:57:07 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:57:07 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:57:07 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:57:07 user nova-compute[75071]:   <serial>6325e95c-25e6-467e-8413-0dca0e38b2e1</serial>
Nov 29 13:57:07 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:57:07 user nova-compute[75071]: </disk>
Nov 29 13:57:07 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:57:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config.
Nov 29 13:57:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:57:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:57:07 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:57:07 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:57:07 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:57:07 user nova-compute[75071]:   <serial>6325e95c-25e6-467e-8413-0dca0e38b2e1</serial>
Nov 29 13:57:07 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:57:07 user nova-compute[75071]: </disk>
Nov 29 13:57:07 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:57:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:57:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:57:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [{"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:57:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=24.93018341064453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 4be37a71-aee1-4a56-9144-1c4ac4e2d86e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:57:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:57:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:57:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:57:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:57:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:57:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:57:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:57:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 is timed out.
Nov 29 13:57:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config.
Nov 29 13:57:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOeHSvBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:57:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb87553-d970-4906-8d8a-7b6f5ec287ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:57:28 user nova-compute[75071]: No targets found.
Nov 29 13:57:28 user nova-compute[75071]: iSNS:
Nov 29 13:57:28 user nova-compute[75071]: No targets found.
Nov 29 13:57:28 user nova-compute[75071]: STATIC:
Nov 29 13:57:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1
Nov 29 13:57:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:57:28 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:57:28 user nova-compute[75071]: FIRMWARE:
Nov 29 13:57:28 user nova-compute[75071]: No targets found.
Nov 29 13:57:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:57:28 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:57:28 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b027da-572d-4ca3-a5f8-e3a6d7d56c52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99dc190-cb9a-4aa6-962f-b5db4b2d9dfc]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 (non-flash)
Nov 29 13:57:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 (non-flash)
Nov 29 13:57:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2148745480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf09d40-fcdf-4432-9964-f1927ee42a2a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd4b429-fdec-4e60-995a-c7af82561d3a]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92d6f1b-0a54-46c9-ba6d-9422cbe98058]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0272d4-da9b-45dc-a2e5-d91b830d6f26]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd90f4-bddf-4e0f-9d75-4f9066a9b7b4]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c60b56-a33e-48b1-a771-072ba1a55e24]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260]
Nov 29 13:57:28 user nova-compute[75071]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1, portal: 172.16.0.220,3260] successful.
Nov 29 13:57:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6325e95c-25e6-467e-8413-0dca0e38b2e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d3582d-8172-4391-b0c3-5ab751ad3f8e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== disconnect_volume: return (293ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:57:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:57:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:57:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-456a4b0e-43e1-42b7-a6f7-58dfa7b3a7b8 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.662s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:57:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:57:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:57:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:57:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:57:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:57:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:57:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:57:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:57:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:57:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:01 user nova-compute[75071]: INFO nova.compute.manager [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attaching volume 0cdd6776-2fa6-49d2-b6f3-109a37a93a1f to /dev/vdb
Nov 29 13:58:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53e0d54-62d1-4f6a-83de-e7f362a13c0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75acd94b-c227-411c-b029-f86aa65b9e6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42987caa-6832-4a9b-82ce-2d40108694eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eee6c7-0542-44a5-9cf2-fe8c6d4c2776]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 13:58:01 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 13:58:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e33856c-e6bc-47ab-9b20-1df553dd33b4]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:58:01 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating existing volume attachment record: 756841aa-57ce-4db2-991b-6c5a1a14202c {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 13:58:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGReJkUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:58:08 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:58:08 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:58:08 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[efed5a1c-db6e-4a3b-8804-740e0a9e82fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 13:58:08 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d06e2a-cf71-4c1b-a221-9b2cd01f931b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f] added
Nov 29 13:58:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3371123b-488c-46dd-bfc5-309a511ad477]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2acf654-b9f3-4058-b533-7ec7d8208504]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGReJkUL {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGReJkUL" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[579cf061-6e2b-447e-8424-e5fa1d1e0e88]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGReJkUL'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b33ede-0426-4c07-b6bd-2a47167a6ced]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cee13b-69d4-407d-8b13-3e04ed4dc76e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:58:08 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 13:58:08 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:58:08 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 13:58:08 user nova-compute[75071]: 
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6339be-06b4-41ba-bfb2-ee82fd0be66d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260]
Nov 29 13:58:08 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260] successful.
Nov 29 13:58:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f3c52-54cd-4237-8395-7a983ae6fec9]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30ba507-9099-4f20-a402-f6076ddf1a9f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f (non-flash)
Nov 29 13:58:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f (non-flash)
Nov 29 13:58:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e877822-87a7-450b-92ae-9e78e230fdde]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 13:58:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGReJkUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 13:58:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:58:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23332643063336138', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:58:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332643063336138', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 13:58:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:58:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 13:58:09 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:58:09 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:58:09 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:58:09 user nova-compute[75071]:   <serial>0cdd6776-2fa6-49d2-b6f3-109a37a93a1f</serial>
Nov 29 13:58:09 user nova-compute[75071]: </disk>
Nov 29 13:58:09 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 13:58:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:58:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 13:58:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] No VIF found with MAC fa:16:3e:75:a7:de, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 13:58:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0d3d4efc-5478-4101-8c79-8d4d697dda6a tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.164s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:12 user nova-compute[75071]: INFO nova.compute.manager [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Detaching volume 0cdd6776-2fa6-49d2-b6f3-109a37a93a1f
Nov 29 13:58:12 user nova-compute[75071]: INFO nova.virt.block_device [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Attempting to driver detach volume 0cdd6776-2fa6-49d2-b6f3-109a37a93a1f from mountpoint /dev/vdb
Nov 29 13:58:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Attempting to detach device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 13:58:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:58:12 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:58:12 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:58:12 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:58:12 user nova-compute[75071]:   <serial>0cdd6776-2fa6-49d2-b6f3-109a37a93a1f</serial>
Nov 29 13:58:12 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:58:12 user nova-compute[75071]: </disk>
Nov 29 13:58:12 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:58:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the persistent domain config.
Nov 29 13:58:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 13:58:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 13:58:12 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 13:58:12 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 13:58:12 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 13:58:12 user nova-compute[75071]:   <serial>0cdd6776-2fa6-49d2-b6f3-109a37a93a1f</serial>
Nov 29 13:58:12 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 13:58:12 user nova-compute[75071]: </disk>
Nov 29 13:58:12 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 13:58:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 13:58:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:58:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:58:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:58:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:58:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Updating instance_info_cache with network_info: [{"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:58:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-4be37a71-aee1-4a56-9144-1c4ac4e2d86e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:58:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:58:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:58:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=24.928485870361328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 4be37a71-aee1-4a56-9144-1c4ac4e2d86e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:58:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:32 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0018886b-15a0-49fd-9e44-701584c9af07 is timed out.
Nov 29 13:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully detached device vdb from instance 0018886b-15a0-49fd-9e44-701584c9af07 from the live domain config.
Nov 29 13:58:32 user nova-compute[75071]: INFO nova.compute.manager [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Terminating instance
Nov 29 13:58:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGReJkUL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 13:58:32 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 13:58:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 13:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dffd42-ba83-44cc-bcdf-7e683ff9308e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 13:58:33 user nova-compute[75071]: No targets found.
Nov 29 13:58:33 user nova-compute[75071]: iSNS:
Nov 29 13:58:33 user nova-compute[75071]: No targets found.
Nov 29 13:58:33 user nova-compute[75071]: STATIC:
Nov 29 13:58:33 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f
Nov 29 13:58:33 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 13:58:33 user nova-compute[75071]:                 Iface Name: default
Nov 29 13:58:33 user nova-compute[75071]: FIRMWARE:
Nov 29 13:58:33 user nova-compute[75071]: No targets found.
Nov 29 13:58:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 13:58:33 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 13:58:33 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db538eb-1a21-48f5-ad77-c471029ba5a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abbd084-3d82-4cc5-bc5a-58c35bf5e414]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f (non-flash)
Nov 29 13:58:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f (non-flash)
Nov 29 13:58:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d537f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23a463f-75bf-40d6-acbc-f1a494d9fbb0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[576d32a3-32c6-4ea5-ac03-f7edea903eb0]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[639f3f1c-63a1-46f6-b461-3dfb00bb094e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e868e6b1-10c7-4ba2-88f6-3b357af107fc]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[162d3baf-e436-4671-911a-60b8de984db1]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-ff28a7aa-e30e-4cf3-b6f1-b1cff7cccab2 req-220fc0f5-5f17-4171-9b30-c65317be7896 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received event network-vif-unplugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff28a7aa-e30e-4cf3-b6f1-b1cff7cccab2 req-220fc0f5-5f17-4171-9b30-c65317be7896 service nova] Acquiring lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff28a7aa-e30e-4cf3-b6f1-b1cff7cccab2 req-220fc0f5-5f17-4171-9b30-c65317be7896 service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ff28a7aa-e30e-4cf3-b6f1-b1cff7cccab2 req-220fc0f5-5f17-4171-9b30-c65317be7896 service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-ff28a7aa-e30e-4cf3-b6f1-b1cff7cccab2 req-220fc0f5-5f17-4171-9b30-c65317be7896 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] No waiting events found dispatching network-vif-unplugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-ff28a7aa-e30e-4cf3-b6f1-b1cff7cccab2 req-220fc0f5-5f17-4171-9b30-c65317be7896 service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received event network-vif-unplugged-502e8337-b918-462f-9c21-f146656b58b6 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[259a1026-8120-4035-9507-146cb5e335cc]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260]
Nov 29 13:58:33 user nova-compute[75071]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f, portal: 172.16.0.220,3260] successful.
Nov 29 13:58:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cdd6776-2fa6-49d2-b6f3-109a37a93a1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6706ec4d-20ea-40c3-9a94-67811581ebab]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] <== disconnect_volume: return (313ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Instance destroyed successfully.
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lazy-loading 'resources' on Instance uuid 4be37a71-aee1-4a56-9144-1c4ac4e2d86e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1243200451',display_name='tempest-VolumesActionsTest-instance-1243200451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1243200451',id=52,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:56:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3465ab0a0cb4ce7ae707fc0d35ef072',ramdisk_id='',reservation_id='r-kcg2nvbs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-364186600',owner_user_name='tempest-VolumesActionsTest-364186600-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:56:41Z,user_data=None,user_id='72463b83606a451d8f3923c5985a8033',uuid=4be37a71-aee1-4a56-9144-1c4ac4e2d86e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Converting VIF {"id": "502e8337-b918-462f-9c21-f146656b58b6", "address": "fa:16:3e:8a:a3:4c", "network": {"id": "cd52d7cb-438e-48e9-8729-1e826de45997", "bridge": "br-int", "label": "tempest-VolumesActionsTest-797083362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3465ab0a0cb4ce7ae707fc0d35ef072", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap502e8337-b9", "ovs_interfaceid": "502e8337-b918-462f-9c21-f146656b58b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=502e8337-b918-462f-9c21-f146656b58b6,network=Network(cd52d7cb-438e-48e9-8729-1e826de45997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e8337-b9') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG os_vif [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=502e8337-b918-462f-9c21-f146656b58b6,network=Network(cd52d7cb-438e-48e9-8729-1e826de45997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e8337-b9') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap502e8337-b9, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e7365b0-3e30-4ef5-8694-7e65d276842b) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:33 user nova-compute[75071]: INFO os_vif [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=502e8337-b918-462f-9c21-f146656b58b6,network=Network(cd52d7cb-438e-48e9-8729-1e826de45997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap502e8337-b9')
Nov 29 13:58:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Deleting instance files /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e_del
Nov 29 13:58:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Deletion of /opt/stack/data/nova/instances/4be37a71-aee1-4a56-9144-1c4ac4e2d86e_del complete
Nov 29 13:58:33 user nova-compute[75071]: INFO nova.compute.manager [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 13:58:33 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:58:33 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:58:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'flavor' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:58:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32118fcf-b93a-43a1-8701-b9abb228d0d1 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:34 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:58:34 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Took 0.43 seconds to deallocate network for instance.
Nov 29 13:58:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:34 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:58:34 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:58:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:34 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Deleted allocations for instance 4be37a71-aee1-4a56-9144-1c4ac4e2d86e
Nov 29 13:58:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fdfa91b3-fda6-42cf-98ee-b79b16de33d1 tempest-VolumesActionsTest-364186600 tempest-VolumesActionsTest-364186600-project-member] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.630s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-7836c3f1-18ce-4a71-b1a8-8dfb52a3af99 req-eaf06636-0905-4cc5-9bb9-04321a588f7b service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received event network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:58:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7836c3f1-18ce-4a71-b1a8-8dfb52a3af99 req-eaf06636-0905-4cc5-9bb9-04321a588f7b service nova] Acquiring lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:58:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7836c3f1-18ce-4a71-b1a8-8dfb52a3af99 req-eaf06636-0905-4cc5-9bb9-04321a588f7b service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:58:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7836c3f1-18ce-4a71-b1a8-8dfb52a3af99 req-eaf06636-0905-4cc5-9bb9-04321a588f7b service nova] Lock "4be37a71-aee1-4a56-9144-1c4ac4e2d86e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:58:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-7836c3f1-18ce-4a71-b1a8-8dfb52a3af99 req-eaf06636-0905-4cc5-9bb9-04321a588f7b service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] No waiting events found dispatching network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:58:35 user nova-compute[75071]: WARNING nova.compute.manager [req-7836c3f1-18ce-4a71-b1a8-8dfb52a3af99 req-eaf06636-0905-4cc5-9bb9-04321a588f7b service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received unexpected event network-vif-plugged-502e8337-b918-462f-9c21-f146656b58b6 for instance with vm_state deleted and task_state None.
Nov 29 13:58:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-7836c3f1-18ce-4a71-b1a8-8dfb52a3af99 req-eaf06636-0905-4cc5-9bb9-04321a588f7b service nova] [instance: 4be37a71-aee1-4a56-9144-1c4ac4e2d86e] Received event network-vif-deleted-502e8337-b918-462f-9c21-f146656b58b6 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:58:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:58:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:58:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:58:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 13:59:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:59:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:59:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:59:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:59:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 13:59:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 13:59:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 13:59:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 13:59:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 13:59:16 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:59:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [{"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:59:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-0018886b-15a0-49fd-9e44-701584c9af07" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 13:59:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 13:59:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 13:59:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 13:59:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:59:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 13:59:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=24.955177307128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:59:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance 0018886b-15a0-49fd-9e44-701584c9af07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:59:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:59:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 13:59:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 13:59:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:59:31 user nova-compute[75071]: INFO nova.compute.manager [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Terminating instance
Nov 29 13:59:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-23251ed3-6946-4b62-b8ab-cd0541dba720 req-f0c2b7e3-6dfe-4a38-9e69-5843dbe01693 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-vif-unplugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-23251ed3-6946-4b62-b8ab-cd0541dba720 req-f0c2b7e3-6dfe-4a38-9e69-5843dbe01693 service nova] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-23251ed3-6946-4b62-b8ab-cd0541dba720 req-f0c2b7e3-6dfe-4a38-9e69-5843dbe01693 service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-23251ed3-6946-4b62-b8ab-cd0541dba720 req-f0c2b7e3-6dfe-4a38-9e69-5843dbe01693 service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-23251ed3-6946-4b62-b8ab-cd0541dba720 req-f0c2b7e3-6dfe-4a38-9e69-5843dbe01693 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] No waiting events found dispatching network-vif-unplugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-23251ed3-6946-4b62-b8ab-cd0541dba720 req-f0c2b7e3-6dfe-4a38-9e69-5843dbe01693 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-vif-unplugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 13:59:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Instance destroyed successfully.
Nov 29 13:59:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lazy-loading 'resources' on Instance uuid 0018886b-15a0-49fd-9e44-701584c9af07 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T13:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1332514440',display_name='tempest-SnapshotDataIntegrityTests-server-1332514440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1332514440',id=50,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISa1Yawknc9Xf1gqj8LzprzRK+Zf6dM3QWnRYPxS0g/Iaazp2eCfy3t6jyyMeN+x8AJU0Yufaz7/00dMa29xlBXpPwmUC3lQqBwV5bd3CiAsYLp7RJ/2xnlXuNxwprMtw==',key_name='tempest-keypair-1091950787',keypairs=<?>,launch_index=0,launched_at=2023-11-29T13:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='166ae7adf5554864ba35e7c8f8788080',ramdisk_id='',reservation_id='r-uzjcpkml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-360029068',owner_user_name='tempest-SnapshotDataIntegrityTests-360029068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T13:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c1ab8eb652149299900db6fab0c58f7',uuid=0018886b-15a0-49fd-9e44-701584c9af07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Converting VIF {"id": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "address": "fa:16:3e:75:a7:de", "network": {"id": "54cc6fbf-08af-43a5-a73d-d9e7454ec294", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2006525201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "166ae7adf5554864ba35e7c8f8788080", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee8c81a5-3e", "ovs_interfaceid": "ee8c81a5-3eaa-444f-9eee-ecce33900718", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a7:de,bridge_name='br-int',has_traffic_filtering=True,id=ee8c81a5-3eaa-444f-9eee-ecce33900718,network=Network(54cc6fbf-08af-43a5-a73d-d9e7454ec294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee8c81a5-3e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG os_vif [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a7:de,bridge_name='br-int',has_traffic_filtering=True,id=ee8c81a5-3eaa-444f-9eee-ecce33900718,network=Network(54cc6fbf-08af-43a5-a73d-d9e7454ec294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee8c81a5-3e') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee8c81a5-3e, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46d2254d-e54a-4d30-9a96-40fe625c6561) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:32 user nova-compute[75071]: INFO os_vif [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a7:de,bridge_name='br-int',has_traffic_filtering=True,id=ee8c81a5-3eaa-444f-9eee-ecce33900718,network=Network(54cc6fbf-08af-43a5-a73d-d9e7454ec294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee8c81a5-3e')
Nov 29 13:59:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Deleting instance files /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07_del
Nov 29 13:59:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Deletion of /opt/stack/data/nova/instances/0018886b-15a0-49fd-9e44-701584c9af07_del complete
Nov 29 13:59:32 user nova-compute[75071]: INFO nova.compute.manager [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 29 13:59:32 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 13:59:32 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:59:33 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Took 0.75 seconds to deallocate network for instance.
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-85e94957-b898-40c8-ad7f-1f83c55de491 req-51e022be-51ca-43e2-bebe-0f18cb00d753 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-vif-deleted-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:59:33 user nova-compute[75071]: INFO nova.compute.manager [req-85e94957-b898-40c8-ad7f-1f83c55de491 req-51e022be-51ca-43e2-bebe-0f18cb00d753 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Neutron deleted interface ee8c81a5-3eaa-444f-9eee-ecce33900718; detaching it from the instance and deleting it from the info cache
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.network.neutron [req-85e94957-b898-40c8-ad7f-1f83c55de491 req-51e022be-51ca-43e2-bebe-0f18cb00d753 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-85e94957-b898-40c8-ad7f-1f83c55de491 req-51e022be-51ca-43e2-bebe-0f18cb00d753 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Detach interface failed, port_id=ee8c81a5-3eaa-444f-9eee-ecce33900718, reason: Instance 0018886b-15a0-49fd-9e44-701584c9af07 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:59:33 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Deleted allocations for instance 0018886b-15a0-49fd-9e44-701584c9af07
Nov 29 13:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0d79a8c-ad5a-435a-849a-d49f489fcdd7 tempest-SnapshotDataIntegrityTests-360029068 tempest-SnapshotDataIntegrityTests-360029068-project-member] Lock "0018886b-15a0-49fd-9e44-701584c9af07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e2c0137-6a7d-499e-94b4-b823c75f2565 req-16492934-bc16-468d-ac17-09f118f215d7 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received event network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e2c0137-6a7d-499e-94b4-b823c75f2565 req-16492934-bc16-468d-ac17-09f118f215d7 service nova] Acquiring lock "0018886b-15a0-49fd-9e44-701584c9af07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e2c0137-6a7d-499e-94b4-b823c75f2565 req-16492934-bc16-468d-ac17-09f118f215d7 service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e2c0137-6a7d-499e-94b4-b823c75f2565 req-16492934-bc16-468d-ac17-09f118f215d7 service nova] Lock "0018886b-15a0-49fd-9e44-701584c9af07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 13:59:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e2c0137-6a7d-499e-94b4-b823c75f2565 req-16492934-bc16-468d-ac17-09f118f215d7 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] No waiting events found dispatching network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 13:59:33 user nova-compute[75071]: WARNING nova.compute.manager [req-3e2c0137-6a7d-499e-94b4-b823c75f2565 req-16492934-bc16-468d-ac17-09f118f215d7 service nova] [instance: 0018886b-15a0-49fd-9e44-701584c9af07] Received unexpected event network-vif-plugged-ee8c81a5-3eaa-444f-9eee-ecce33900718 for instance with vm_state deleted and task_state None.
Nov 29 13:59:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:59:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 13:59:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 13:59:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:59:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 13:59:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 13:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:00:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:00:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:00:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:00:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:00:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:00:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:00:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:00:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=24.972869873046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:00:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:00:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:00:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:00:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:00:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:00:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:01:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:01:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:01:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:01:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:01:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:01:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=24.97061538696289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:01:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:01:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:01:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:01:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:01:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:01:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:01:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:01:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:02:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:02:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:02:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:02:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:02:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:02:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:02:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:02:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:02:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:02:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8843MB free_disk=24.96551513671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 14:02:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 14:02:32 user nova-compute[75071]: INFO nova.compute.claims [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Claim successful on node user
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 14:02:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.policy [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66186700b0ad4842b59747c1eefd0ea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ccff9cc11c40b5986b0b45fe959132', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 14:02:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Creating image(s)
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "/opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "/opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3,backing_fmt=raw /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk 1073741824" returned: 0 in 0.062s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "23dc25edb6296a5252fe82fa2de01118e42ba1b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Successfully created port: 29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23dc25edb6296a5252fe82fa2de01118e42ba1b3 --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Cannot resize image /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Ensure instance console log exists: /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Successfully updated port: 29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 14:02:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-changed-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Refreshing instance network info cache due to event network-changed-29b0db46-0d70-4259-9408-98833af95801. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Instance network_info: |[{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Refreshing network info cache for port 29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Start _get_guest_xml network_info=[{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'size': 0, 'encryption_options': None, 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '794347ff-8cf3-49d9-8652-9f89337799af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 14:02:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:02:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T13:13:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T13:14:03Z,direct_url=<?>,disk_format='qcow2',id=794347ff-8cf3-49d9-8652-9f89337799af,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d2a2352f6278404fb75ba04f146b00d2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T13:14:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-726020252',display_name='tempest-SnapshotDataIntegrityTests-server-726020252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-726020252',id=53,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlqdzKck7D6MjM7+LD+QbuPg04ef03iLpOhQOsCckG7dE7eF8yB4JmUzgcjPwMODTFQoyq94zL/t8JnERWXLmm7UnWSWatxnGBqby45D4TBp+718pbJBhd59jmlCJCM0A==',key_name='tempest-keypair-358523378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ccff9cc11c40b5986b0b45fe959132',ramdisk_id='',reservation_id='r-ln0m20ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1148232701',owner_user_name='tempest-SnapshotDataIntegrityTests-1148232701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66186700b0ad4842b59747c1eefd0ea1',uuid=f3365c50-a05d-4999-a081-30e88b4769f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Converting VIF {"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:eb:43,bridge_name='br-int',has_traffic_filtering=True,id=29b0db46-0d70-4259-9408-98833af95801,network=Network(e560d562-e9d3-4c54-874a-da48dd8da518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0db46-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'pci_devices' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 14:02:35 user nova-compute[75071]:   <uuid>f3365c50-a05d-4999-a081-30e88b4769f7</uuid>
Nov 29 14:02:35 user nova-compute[75071]:   <name>instance-00000035</name>
Nov 29 14:02:35 user nova-compute[75071]:   <memory>524288</memory>
Nov 29 14:02:35 user nova-compute[75071]:   <vcpu>1</vcpu>
Nov 29 14:02:35 user nova-compute[75071]:   <metadata>
Nov 29 14:02:35 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 14:02:35 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Nov 29 14:02:35 user nova-compute[75071]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-726020252</nova:name>
Nov 29 14:02:35 user nova-compute[75071]:       <nova:creationTime>2023-11-29 14:02:35</nova:creationTime>
Nov 29 14:02:35 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Nov 29 14:02:35 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Nov 29 14:02:35 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Nov 29 14:02:35 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Nov 29 14:02:35 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 14:02:35 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Nov 29 14:02:35 user nova-compute[75071]:       </nova:flavor>
Nov 29 14:02:35 user nova-compute[75071]:       <nova:owner>
Nov 29 14:02:35 user nova-compute[75071]:         <nova:user uuid="66186700b0ad4842b59747c1eefd0ea1">tempest-SnapshotDataIntegrityTests-1148232701-project-member</nova:user>
Nov 29 14:02:35 user nova-compute[75071]:         <nova:project uuid="66ccff9cc11c40b5986b0b45fe959132">tempest-SnapshotDataIntegrityTests-1148232701</nova:project>
Nov 29 14:02:35 user nova-compute[75071]:       </nova:owner>
Nov 29 14:02:35 user nova-compute[75071]:       <nova:root type="image" uuid="794347ff-8cf3-49d9-8652-9f89337799af"/>
Nov 29 14:02:35 user nova-compute[75071]:       <nova:ports>
Nov 29 14:02:35 user nova-compute[75071]:         <nova:port uuid="29b0db46-0d70-4259-9408-98833af95801">
Nov 29 14:02:35 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 14:02:35 user nova-compute[75071]:         </nova:port>
Nov 29 14:02:35 user nova-compute[75071]:       </nova:ports>
Nov 29 14:02:35 user nova-compute[75071]:     </nova:instance>
Nov 29 14:02:35 user nova-compute[75071]:   </metadata>
Nov 29 14:02:35 user nova-compute[75071]:   <sysinfo type="smbios">
Nov 29 14:02:35 user nova-compute[75071]:     <system>
Nov 29 14:02:35 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 14:02:35 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Nov 29 14:02:35 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Nov 29 14:02:35 user nova-compute[75071]:       <entry name="serial">f3365c50-a05d-4999-a081-30e88b4769f7</entry>
Nov 29 14:02:35 user nova-compute[75071]:       <entry name="uuid">f3365c50-a05d-4999-a081-30e88b4769f7</entry>
Nov 29 14:02:35 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Nov 29 14:02:35 user nova-compute[75071]:     </system>
Nov 29 14:02:35 user nova-compute[75071]:   </sysinfo>
Nov 29 14:02:35 user nova-compute[75071]:   <os>
Nov 29 14:02:35 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 14:02:35 user nova-compute[75071]:     <boot dev="hd"/>
Nov 29 14:02:35 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Nov 29 14:02:35 user nova-compute[75071]:   </os>
Nov 29 14:02:35 user nova-compute[75071]:   <features>
Nov 29 14:02:35 user nova-compute[75071]:     <acpi/>
Nov 29 14:02:35 user nova-compute[75071]:     <apic/>
Nov 29 14:02:35 user nova-compute[75071]:     <vmcoreinfo/>
Nov 29 14:02:35 user nova-compute[75071]:   </features>
Nov 29 14:02:35 user nova-compute[75071]:   <clock offset="utc">
Nov 29 14:02:35 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 14:02:35 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 14:02:35 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Nov 29 14:02:35 user nova-compute[75071]:   </clock>
Nov 29 14:02:35 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Nov 29 14:02:35 user nova-compute[75071]:     <model>Nehalem</model>
Nov 29 14:02:35 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 14:02:35 user nova-compute[75071]:   </cpu>
Nov 29 14:02:35 user nova-compute[75071]:   <devices>
Nov 29 14:02:35 user nova-compute[75071]:     <disk type="file" device="disk">
Nov 29 14:02:35 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 14:02:35 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk"/>
Nov 29 14:02:35 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Nov 29 14:02:35 user nova-compute[75071]:     </disk>
Nov 29 14:02:35 user nova-compute[75071]:     <interface type="ethernet">
Nov 29 14:02:35 user nova-compute[75071]:       <mac address="fa:16:3e:25:eb:43"/>
Nov 29 14:02:35 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 14:02:35 user nova-compute[75071]:       <mtu size="1442"/>
Nov 29 14:02:35 user nova-compute[75071]:       <target dev="tap29b0db46-0d"/>
Nov 29 14:02:35 user nova-compute[75071]:     </interface>
Nov 29 14:02:35 user nova-compute[75071]:     <serial type="pty">
Nov 29 14:02:35 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/console.log" append="off"/>
Nov 29 14:02:35 user nova-compute[75071]:     </serial>
Nov 29 14:02:35 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 14:02:35 user nova-compute[75071]:     <video>
Nov 29 14:02:35 user nova-compute[75071]:       <model type="virtio"/>
Nov 29 14:02:35 user nova-compute[75071]:     </video>
Nov 29 14:02:35 user nova-compute[75071]:     <rng model="virtio">
Nov 29 14:02:35 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Nov 29 14:02:35 user nova-compute[75071]:     </rng>
Nov 29 14:02:35 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Nov 29 14:02:35 user nova-compute[75071]:     <memballoon model="virtio">
Nov 29 14:02:35 user nova-compute[75071]:       <stats period="10"/>
Nov 29 14:02:35 user nova-compute[75071]:     </memballoon>
Nov 29 14:02:35 user nova-compute[75071]:   </devices>
Nov 29 14:02:35 user nova-compute[75071]: </domain>
Nov 29 14:02:35 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-726020252',display_name='tempest-SnapshotDataIntegrityTests-server-726020252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-726020252',id=53,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlqdzKck7D6MjM7+LD+QbuPg04ef03iLpOhQOsCckG7dE7eF8yB4JmUzgcjPwMODTFQoyq94zL/t8JnERWXLmm7UnWSWatxnGBqby45D4TBp+718pbJBhd59jmlCJCM0A==',key_name='tempest-keypair-358523378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66ccff9cc11c40b5986b0b45fe959132',ramdisk_id='',reservation_id='r-ln0m20ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1148232701',owner_user_name='tempest-SnapshotDataIntegrityTests-1148232701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T14:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66186700b0ad4842b59747c1eefd0ea1',uuid=f3365c50-a05d-4999-a081-30e88b4769f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Converting VIF {"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:eb:43,bridge_name='br-int',has_traffic_filtering=True,id=29b0db46-0d70-4259-9408-98833af95801,network=Network(e560d562-e9d3-4c54-874a-da48dd8da518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0db46-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG os_vif [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:eb:43,bridge_name='br-int',has_traffic_filtering=True,id=29b0db46-0d70-4259-9408-98833af95801,network=Network(e560d562-e9d3-4c54-874a-da48dd8da518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0db46-0d') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fae297b-1c58-58d6-99a3-da0c688b1e54', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29b0db46-0d, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29b0db46-0d, col_values=(('qos', UUID('49cf822c-247f-4902-9865-687adda690f4')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29b0db46-0d, col_values=(('external_ids', {'iface-id': '29b0db46-0d70-4259-9408-98833af95801', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:eb:43', 'vm-uuid': 'f3365c50-a05d-4999-a081-30e88b4769f7'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:35 user nova-compute[75071]: INFO os_vif [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:eb:43,bridge_name='br-int',has_traffic_filtering=True,id=29b0db46-0d70-4259-9408-98833af95801,network=Network(e560d562-e9d3-4c54-874a-da48dd8da518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0db46-0d')
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No VIF found with MAC fa:16:3e:25:eb:43, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated VIF entry in instance network info cache for port 29b0db46-0d70-4259-9408-98833af95801. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:02:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-67345abe-b26d-4e39-8eb2-65bdbde4e46d req-9af72deb-72c9-4bff-88d2-159ce034c955 service nova] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-61371547-37ac-4b37-b893-f29c930c368b req-38cec56d-a9ff-4beb-97a6-0ef2732fdeed service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61371547-37ac-4b37-b893-f29c930c368b req-38cec56d-a9ff-4beb-97a6-0ef2732fdeed service nova] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61371547-37ac-4b37-b893-f29c930c368b req-38cec56d-a9ff-4beb-97a6-0ef2732fdeed service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-61371547-37ac-4b37-b893-f29c930c368b req-38cec56d-a9ff-4beb-97a6-0ef2732fdeed service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-61371547-37ac-4b37-b893-f29c930c368b req-38cec56d-a9ff-4beb-97a6-0ef2732fdeed service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] No waiting events found dispatching network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:02:37 user nova-compute[75071]: WARNING nova.compute.manager [req-61371547-37ac-4b37-b893-f29c930c368b req-38cec56d-a9ff-4beb-97a6-0ef2732fdeed service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received unexpected event network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 for instance with vm_state building and task_state spawning.
Nov 29 14:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-decc4dc8-0194-4a09-bae1-86dc82d2609a req-aa8ea330-14ee-41da-a004-b07490ed6ea1 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-decc4dc8-0194-4a09-bae1-86dc82d2609a req-aa8ea330-14ee-41da-a004-b07490ed6ea1 service nova] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-decc4dc8-0194-4a09-bae1-86dc82d2609a req-aa8ea330-14ee-41da-a004-b07490ed6ea1 service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-decc4dc8-0194-4a09-bae1-86dc82d2609a req-aa8ea330-14ee-41da-a004-b07490ed6ea1 service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-decc4dc8-0194-4a09-bae1-86dc82d2609a req-aa8ea330-14ee-41da-a004-b07490ed6ea1 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] No waiting events found dispatching network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:02:39 user nova-compute[75071]: WARNING nova.compute.manager [req-decc4dc8-0194-4a09-bae1-86dc82d2609a req-aa8ea330-14ee-41da-a004-b07490ed6ea1 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received unexpected event network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 for instance with vm_state building and task_state spawning.
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 14:02:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Instance spawned successfully.
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 14:02:39 user nova-compute[75071]: INFO nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 29 14:02:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 14:02:39 user nova-compute[75071]: INFO nova.compute.manager [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Took 7.05 seconds to build instance.
Nov 29 14:02:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f54f0-8812-4c67-b32e-a318ca348c48 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.172s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:02:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:02:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:03:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:03:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:03:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:03:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=24.92510986328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:03:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f3365c50-a05d-4999-a081-30e88b4769f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:03:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:03:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:03:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:04:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:04:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:04:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-changed-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Refreshing instance network info cache due to event network-changed-29b0db46-0d70-4259-9408-98833af95801. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Refreshing network info cache for port 29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated VIF entry in instance network info cache for port 29b0db46-0d70-4259-9408-98833af95801. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:04:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9e53644f-6ab8-4aef-b42e-4fd9ad051d2c req-63e68607-530b-42ad-9beb-fcdf1b9c7f44 service nova] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:04:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:04:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:04:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=24.923477172851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f3365c50-a05d-4999-a081-30e88b4769f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.objects.instance [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:04:27 user nova-compute[75071]: INFO nova.compute.manager [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attaching volume 3b338b73-5206-4758-998e-c34576d88fcf to /dev/vdb
Nov 29 14:04:27 user nova-compute[75071]: DEBUG os_brick.utils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbedc9fc-0697-44e4-ae32-513a0b31dd37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[49045dcf-1b27-4283-bf8e-f94fd59c2ef6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be73254e-4e97-419a-94f9-98d807438c48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd919f-5311-4afc-a7d4-690ab4ebc272]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:04:27 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:04:27 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2419749e-efd9-48dc-9929-dfb0cf0ef7cf]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG os_brick.utils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:04:27 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating existing volume attachment record: 16343726-bc20-4d70-923b-2fb7deb3f82a {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:04:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFlKPQCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:04:34 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:04:34 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:04:34 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e413c14-bb6a-4d87-8492-565fda9bb490]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:04:34 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19036c3-7db3-4f0c-a92a-799bfbb4067f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf] added
Nov 29 14:04:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8173ce7-2752-44ba-8a86-dd50e450f1fd]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9cc674-c088-45d8-916f-5b186d4d47d6]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFlKPQCh {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFlKPQCh" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[099e10fd-a249-4182-82c8-5e6350b7a179]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mFlKPQCh'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f306574-dba9-4a25-b5ee-2f9e02683a8c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a85d1e-ea7e-47a8-bf69-ad5647f52d5a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:04:34 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:04:34 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:04:34 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 14:04:34 user nova-compute[75071]: 
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a04841-a1c3-4350-bf26-07e398b2c3b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260]
Nov 29 14:04:34 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260] successful.
Nov 29 14:04:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75d6396-dc57-4d61-a9ee-5426bdbe0223]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee12bec9-cf0f-43ab-9970-798bbd748a74]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf (non-flash)
Nov 29 14:04:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf (non-flash)
Nov 29 14:04:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[164e7625-6de3-4b90-8b1a-036192765a5e]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:04:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFlKPQCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23262373166656164', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262373166656164', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:04:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:04:35 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:04:35 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:04:35 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:04:35 user nova-compute[75071]:   <serial>3b338b73-5206-4758-998e-c34576d88fcf</serial>
Nov 29 14:04:35 user nova-compute[75071]: </disk>
Nov 29 14:04:35 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:04:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:04:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:04:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No VIF found with MAC fa:16:3e:25:eb:43, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:04:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-900aad02-ee3a-41f5-ba35-68d0fabcf6ff tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.165s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:04:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:04:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:04:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:04:51 user nova-compute[75071]: INFO nova.compute.manager [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Detaching volume 3b338b73-5206-4758-998e-c34576d88fcf
Nov 29 14:04:51 user nova-compute[75071]: INFO nova.virt.block_device [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attempting to driver detach volume 3b338b73-5206-4758-998e-c34576d88fcf from mountpoint /dev/vdb
Nov 29 14:04:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Attempting to detach device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:04:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:04:51 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:04:51 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:04:51 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:04:51 user nova-compute[75071]:   <serial>3b338b73-5206-4758-998e-c34576d88fcf</serial>
Nov 29 14:04:51 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:04:51 user nova-compute[75071]: </disk>
Nov 29 14:04:51 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:04:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config.
Nov 29 14:04:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:04:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:04:51 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:04:51 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:04:51 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:04:51 user nova-compute[75071]:   <serial>3b338b73-5206-4758-998e-c34576d88fcf</serial>
Nov 29 14:04:51 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:04:51 user nova-compute[75071]: </disk>
Nov 29 14:04:51 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:04:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:04:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:04:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 is timed out.
Nov 29 14:05:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config.
Nov 29 14:05:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFlKPQCh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:05:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f85ac2-5dde-413a-89a6-21ba0a056073]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:05:11 user nova-compute[75071]: No targets found.
Nov 29 14:05:11 user nova-compute[75071]: iSNS:
Nov 29 14:05:11 user nova-compute[75071]: No targets found.
Nov 29 14:05:11 user nova-compute[75071]: STATIC:
Nov 29 14:05:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf
Nov 29 14:05:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:05:11 user nova-compute[75071]:                 Iface Name: default
Nov 29 14:05:11 user nova-compute[75071]: FIRMWARE:
Nov 29 14:05:11 user nova-compute[75071]: No targets found.
Nov 29 14:05:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:05:11 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:05:11 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52878d39-4461-43f6-ac06-aa593b7d28e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f668ea23-6d94-4835-ade8-972e7bdac679]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf (non-flash)
Nov 29 14:05:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf (non-flash)
Nov 29 14:05:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124faff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80354393-a4ea-4504-958d-ccad34506ec6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c06ff1-da32-431b-83d9-23859b87fa23]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3751fd14-872d-48e0-81a1-27775e6fb83e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8ebbbe-0aa7-4848-a325-198b9a8ce5d6]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[280ac534-9469-4f53-98cc-f656586227de]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee933e-bc4f-42f5-8a7a-074219774f4a]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260]
Nov 29 14:05:12 user nova-compute[75071]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf, portal: 172.16.0.220,3260] successful.
Nov 29 14:05:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b338b73-5206-4758-998e-c34576d88fcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7b03dc-b58b-4f6f-80c4-2832dd3395db]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== disconnect_volume: return (279ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:05:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3560c43b-d7b3-4ca7-b2b9-e59e5baf6b30 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.628s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:05:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:05:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Triggering sync for uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 14:05:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:05:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:05:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:05:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:05:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:05:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:05:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:05:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.922264099121094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f3365c50-a05d-4999-a081-30e88b4769f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:05:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:05:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:05:44 user nova-compute[75071]: INFO nova.compute.manager [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attaching volume fba11ae6-e806-474f-9978-c54b809216f1 to /dev/vdb
Nov 29 14:05:44 user nova-compute[75071]: DEBUG os_brick.utils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bacaec-c3e9-4c24-afd6-749c42153560]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31524242-ab90-403d-9c15-2819673a10f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67477c53-9ab2-473d-a5e4-12b3078fd792]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6310677a-db9e-4846-9f27-583c99df72a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:05:44 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:05:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a372c84-cbbf-4c1b-81da-44a8d10796d7]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG os_brick.utils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating existing volume attachment record: 94f93548-9a74-4b99-b5cd-3eef86415b4f {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:05:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhboUfsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:05:51 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:05:51 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:05:51 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[842d5756-10cd-48ef-810d-32e6c96f8cb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:05:51 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6d49fc-ede0-42d4-91ae-d205d9f41d35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1] added
Nov 29 14:05:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9774156-2984-4e1e-b090-67043e245d00]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d26ce9-43a8-4e50-978b-7d943197d7cf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhboUfsL {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhboUfsL" returned: 0 in 0.025s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb954b20-5563-4e89-86ab-2d15b68267c7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PhboUfsL'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84687ce5-b98d-4910-a6fb-5070ffd9a492]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ed371-e53a-4d4e-9574-c8c374c5c7c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:05:51 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:05:51 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:05:51 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 14:05:51 user nova-compute[75071]: 
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd4b96-9b8e-48a2-b366-df13d5ba5c05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260]
Nov 29 14:05:51 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260] successful.
Nov 29 14:05:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed68534b-01cc-4405-af6f-6d3c3e9406ca]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d8e047-9a71-4536-81c9-a40f5fedfd3a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 (non-flash)
Nov 29 14:05:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 (non-flash)
Nov 29 14:05:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d41940-3f04-4f25-abcc-c0e908061065]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:05:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhboUfsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:05:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:05:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26666646131346530', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:05:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666646131346530', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:05:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:05:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:05:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:05:52 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:05:52 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:05:52 user nova-compute[75071]:   <serial>fba11ae6-e806-474f-9978-c54b809216f1</serial>
Nov 29 14:05:52 user nova-compute[75071]: </disk>
Nov 29 14:05:52 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:05:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:05:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:05:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No VIF found with MAC fa:16:3e:25:eb:43, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:05:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e383801-cc41-4c94-9fe5-14b7971baa27 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.074s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:05:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:05:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:05:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:05:55 user nova-compute[75071]: INFO nova.compute.manager [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Detaching volume fba11ae6-e806-474f-9978-c54b809216f1
Nov 29 14:05:55 user nova-compute[75071]: INFO nova.virt.block_device [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attempting to driver detach volume fba11ae6-e806-474f-9978-c54b809216f1 from mountpoint /dev/vdb
Nov 29 14:05:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Attempting to detach device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:05:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:05:55 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:05:55 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:05:55 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:05:55 user nova-compute[75071]:   <serial>fba11ae6-e806-474f-9978-c54b809216f1</serial>
Nov 29 14:05:55 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:05:55 user nova-compute[75071]: </disk>
Nov 29 14:05:55 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:05:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config.
Nov 29 14:05:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:05:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:05:55 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:05:55 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:05:55 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:05:55 user nova-compute[75071]:   <serial>fba11ae6-e806-474f-9978-c54b809216f1</serial>
Nov 29 14:05:55 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:05:55 user nova-compute[75071]: </disk>
Nov 29 14:05:55 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:05:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:05:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:06:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 is timed out.
Nov 29 14:06:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config.
Nov 29 14:06:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhboUfsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:06:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[64779811-fe05-4ab1-8c67-d47523df04c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:06:16 user nova-compute[75071]: No targets found.
Nov 29 14:06:16 user nova-compute[75071]: iSNS:
Nov 29 14:06:16 user nova-compute[75071]: No targets found.
Nov 29 14:06:16 user nova-compute[75071]: STATIC:
Nov 29 14:06:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1
Nov 29 14:06:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:06:16 user nova-compute[75071]:                 Iface Name: default
Nov 29 14:06:16 user nova-compute[75071]: FIRMWARE:
Nov 29 14:06:16 user nova-compute[75071]: No targets found.
Nov 29 14:06:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:06:16 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:06:16 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b956caee-5deb-4cb4-a75a-6e9283b30690]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddcae15-4404-4d52-ad48-cefd9bc76f90]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 (non-flash)
Nov 29 14:06:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 (non-flash)
Nov 29 14:06:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124cadea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a36bfd1-c170-494c-a314-bf69834dbb28]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8304ee-4d96-4979-a289-637cbd178f0f]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1f471-5e08-45ef-88c0-0799f2b99b7b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4068817-b8e0-4100-9cb8-2c262d589c9e]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3051cbd-0b0c-4ec3-9437-33ea1ac985de]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[58552b86-3e7c-4749-918a-8692c55cd330]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260]
Nov 29 14:06:16 user nova-compute[75071]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1, portal: 172.16.0.220,3260] successful.
Nov 29 14:06:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fba11ae6-e806-474f-9978-c54b809216f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[467dd6c3-205c-47ee-a19d-8aa7953fc16c]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== disconnect_volume: return (293ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:06:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:06:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:06:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d789a06-2801-4a01-9479-cb0127d068e9 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.659s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:06:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:06:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:06:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:06:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.921337127685547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f3365c50-a05d-4999-a081-30e88b4769f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:06:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:06:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:06:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:06:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:06:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:06:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:06:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:06:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:06:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:06:49 user nova-compute[75071]: INFO nova.compute.manager [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attaching volume 34d69617-9256-4591-9e7b-8a2f88336f3d to /dev/vdb
Nov 29 14:06:49 user nova-compute[75071]: DEBUG os_brick.utils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffc98fd-399b-4c5b-8b7c-b4e674780b0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f36027f-83aa-4e86-a088-eec8ea973647]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[127acd15-cc8a-4287-8921-aefd08254a15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee19a82c-d55e-42a8-be13-7fa6fb86379a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:06:49 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:06:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe02247c-c992-49ec-b2ac-571e612a4585]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG os_brick.utils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating existing volume attachment record: b689ff75-019e-4c61-bd63-2068e88ad1f7 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:06:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnNATDjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:06:56 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:06:56 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:06:56 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df8b005-0bac-4735-9c36-e152469e710a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:06:56 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2411fcb-a6ee-4d47-82ca-3ce16c0a5f49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d] added
Nov 29 14:06:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[134f1484-fe9c-4285-aefd-0f2046ba0d5e]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fac104-6882-4bd8-b01e-5eced63c87ad]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnNATDjv {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnNATDjv" returned: 0 in 0.022s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3787a8dc-8b61-47e7-a39d-290c2358a76b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnNATDjv'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c870cde-3de5-4afb-914a-b0f1589b05ad]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf725a1-f745-4d83-904d-cd8c7da6f7ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:06:56 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:06:56 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:06:56 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 14:06:56 user nova-compute[75071]: 
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8d6ed-0ad3-473c-9c15-6459abaa2b4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260]
Nov 29 14:06:56 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260] successful.
Nov 29 14:06:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4825bc3-2ede-4b6a-89f4-af739e1de97b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e15592-9194-4887-830d-b703d7fa9ab7]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d (non-flash)
Nov 29 14:06:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d (non-flash)
Nov 29 14:06:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf34a3-4fb6-463c-8c96-8f9ba1b30985]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:06:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnNATDjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:06:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:06:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23361633236333035', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:06:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361633236333035', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:06:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:06:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:06:57 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:06:57 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:06:57 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:06:57 user nova-compute[75071]:   <serial>34d69617-9256-4591-9e7b-8a2f88336f3d</serial>
Nov 29 14:06:57 user nova-compute[75071]: </disk>
Nov 29 14:06:57 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:06:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:06:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:06:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No VIF found with MAC fa:16:3e:25:eb:43, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:06:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d47dbb2-65e9-47a8-b399-0f6849b8ed7a tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.090s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:06:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:07:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:07:00 user nova-compute[75071]: INFO nova.compute.manager [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Detaching volume 34d69617-9256-4591-9e7b-8a2f88336f3d
Nov 29 14:07:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:00 user nova-compute[75071]: INFO nova.virt.block_device [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attempting to driver detach volume 34d69617-9256-4591-9e7b-8a2f88336f3d from mountpoint /dev/vdb
Nov 29 14:07:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Attempting to detach device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:07:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:07:00 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:07:00 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:07:00 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:07:00 user nova-compute[75071]:   <serial>34d69617-9256-4591-9e7b-8a2f88336f3d</serial>
Nov 29 14:07:00 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:07:00 user nova-compute[75071]: </disk>
Nov 29 14:07:00 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:07:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config.
Nov 29 14:07:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:07:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:07:00 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:07:00 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:07:00 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:07:00 user nova-compute[75071]:   <serial>34d69617-9256-4591-9e7b-8a2f88336f3d</serial>
Nov 29 14:07:00 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:07:00 user nova-compute[75071]: </disk>
Nov 29 14:07:00 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:07:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:07:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:07:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:07:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 is timed out.
Nov 29 14:07:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config.
Nov 29 14:07:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnNATDjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:07:21 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[698c8497-57d5-4b2d-bed1-caa7f53b2aa2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:07:21 user nova-compute[75071]: No targets found.
Nov 29 14:07:21 user nova-compute[75071]: iSNS:
Nov 29 14:07:21 user nova-compute[75071]: No targets found.
Nov 29 14:07:21 user nova-compute[75071]: STATIC:
Nov 29 14:07:21 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d
Nov 29 14:07:21 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:07:21 user nova-compute[75071]:                 Iface Name: default
Nov 29 14:07:21 user nova-compute[75071]: FIRMWARE:
Nov 29 14:07:21 user nova-compute[75071]: No targets found.
Nov 29 14:07:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:07:21 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:07:21 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaab7eb-26ea-4d38-9e7b-dc522753b12d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f10dd1-1ee1-4d4d-90ac-e262aa492a0f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d (non-flash)
Nov 29 14:07:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d (non-flash)
Nov 29 14:07:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f21484115a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9b3e5d-c30b-44b9-a7c5-5b1a04ff3037]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b450f0e-6b4c-437e-a1e8-38b987e51f57]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d2546a-311a-4f34-812a-97892c77a07b]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37952520-ca36-4c7d-bedc-ede60db4d773]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d641b4-def9-4127-8bfa-586cfbad0883]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20bc1c4-c96c-44f8-8b18-878a4f7f24f9]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260]
Nov 29 14:07:21 user nova-compute[75071]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d, portal: 172.16.0.220,3260] successful.
Nov 29 14:07:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d69617-9256-4591-9e7b-8a2f88336f3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dfd77f-26a3-4e42-8d42-e8549a6ca339]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== disconnect_volume: return (297ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:07:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:07:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e100da26-2c78-46f3-a4b1-7633c4c0cafe tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:07:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:07:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:07:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:07:27 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:07:27 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=24.920326232910156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:07:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:07:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f3365c50-a05d-4999-a081-30e88b4769f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:07:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:07:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:07:28 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:07:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:07:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:07:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:07:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:07:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:31 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:07:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:07:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:07:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:07:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:07:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:07:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:07:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:07:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:07:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:07:54 user nova-compute[75071]: INFO nova.compute.manager [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attaching volume e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 to /dev/vdb
Nov 29 14:07:54 user nova-compute[75071]: DEBUG os_brick.utils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70eb20-4f10-4b76-834b-b3dc196080da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ce8c2fc1e47\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14cdead-57f1-41e7-be6a-a69e3e6404d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a733a9a-c8b4-4b76-b392-757c3ac5d575]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[009c256b-35c0-4d66-9261-eb2830245537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 14:07:54 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 14:07:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9062de-5e85-41da-8650-aa765f97d43f]: (4, '') {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG os_brick.utils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ce8c2fc1e47', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating existing volume attachment record: 49f1813c-1e1f-47bd-9f5b-2377c04df298 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 14:07:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:07:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqsmkzlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:08:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:08:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:08:01 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7edfd92-3e65-49b1-8391-9be0f9c7aed2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 14:08:01 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --interface default --op new {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb2ba6-0a81-4fdc-a054-946c962543fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32] added\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32] added
Nov 29 14:08:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea88c1a-395a-4014-a037-dfa06a654daf]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075bc8b-608f-4a74-b3f1-0239903e6185]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqsmkzlI {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqsmkzlI" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d29ad8-5f71-427e-bce8-37f9cbe64090]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqsmkzlI'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b0f74-5032-4983-a318-557caffd30d7]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6292223-4005-442a-ac95-df600f92efce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:08:01 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 14:08:01 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:08:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 14:08:01 user nova-compute[75071]: 
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --login {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699039b-e68e-487d-989d-5d6c220bab28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260]
Nov 29 14:08:01 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260] successful.
Nov 29 14:08:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6814b2-1fd4-46bb-89d3-645ae728c8a0]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[100adc25-d93f-4de1-9ee3-c4105334fbd3]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 (non-flash)
Nov 29 14:08:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 (non-flash)
Nov 29 14:08:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d73cf1-8a62-4ebc-bb71-f319aa0abd05]: (4, ('- - 0', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 14:08:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqsmkzlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 14:08:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:08:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26332646138616562', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:08:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332646138616562', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 14:08:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:08:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 14:08:02 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:08:02 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:08:02 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:08:02 user nova-compute[75071]:   <serial>e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32</serial>
Nov 29 14:08:02 user nova-compute[75071]: </disk>
Nov 29 14:08:02 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 14:08:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:08:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 14:08:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] No VIF found with MAC fa:16:3e:25:eb:43, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 14:08:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-963d94e4-28df-428e-b2de-dbf7b9c76d74 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.200s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:08:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:08:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:08:05 user nova-compute[75071]: INFO nova.compute.manager [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Detaching volume e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32
Nov 29 14:08:05 user nova-compute[75071]: INFO nova.virt.block_device [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Attempting to driver detach volume e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 from mountpoint /dev/vdb
Nov 29 14:08:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Attempting to detach device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 14:08:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:08:05 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:08:05 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:08:05 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:08:05 user nova-compute[75071]:   <serial>e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32</serial>
Nov 29 14:08:05 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:08:05 user nova-compute[75071]: </disk>
Nov 29 14:08:05 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:08:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the persistent domain config.
Nov 29 14:08:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 14:08:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 14:08:05 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 14:08:05 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Nov 29 14:08:05 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Nov 29 14:08:05 user nova-compute[75071]:   <serial>e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32</serial>
Nov 29 14:08:05 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 14:08:05 user nova-compute[75071]: </disk>
Nov 29 14:08:05 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 14:08:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 14:08:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:08:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:08:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:08:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:25 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3365c50-a05d-4999-a081-30e88b4769f7 is timed out.
Nov 29 14:08:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully detached device vdb from instance f3365c50-a05d-4999-a081-30e88b4769f7 from the live domain config.
Nov 29 14:08:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2148549ba0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqsmkzlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 14:08:25 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1274cb-3a81-4587-bd43-b68d8fc4a360]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 14:08:25 user nova-compute[75071]: No targets found.
Nov 29 14:08:25 user nova-compute[75071]: iSNS:
Nov 29 14:08:25 user nova-compute[75071]: No targets found.
Nov 29 14:08:25 user nova-compute[75071]: STATIC:
Nov 29 14:08:25 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32
Nov 29 14:08:25 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Nov 29 14:08:25 user nova-compute[75071]:                 Iface Name: default
Nov 29 14:08:25 user nova-compute[75071]: FIRMWARE:
Nov 29 14:08:25 user nova-compute[75071]: No targets found.
Nov 29 14:08:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 14:08:25 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 14:08:25 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaad06e3-4553-49f3-ad3c-b8e6b014ddc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d649ed88-b3ba-42cc-9393-5bed24ce2a20]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 (non-flash)\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 (non-flash)
Nov 29 14:08:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 (non-flash)
Nov 29 14:08:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2124d51870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:08:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a4835b-4126-4bf4-9a0c-08c8096f0d0a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcaed4b-9ce0-43e3-8a1e-34d0d652b5d2]: (4, ('ok\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cffcf9a-4fcf-4430-a08b-677477b7ed33]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8388b1ec-89ef-4432-a158-037a4aaaf59c]: (4, ('1', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ac75b-7a56-4753-b832-e5e97a8f7653]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --logout {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3583ee-d7ff-4925-b260-686a56d7df13]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260]
Nov 29 14:08:26 user nova-compute[75071]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32, portal: 172.16.0.220,3260] successful.
Nov 29 14:08:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op delete {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8a4cc1e-84e2-4b6e-a2b9-0cd0cdf5fe32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86044) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8632342d-b832-41b4-88d4-7e9dc2ff70ff]: (4, ('', '')) {{(pid=86044) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] <== disconnect_volume: return (300ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquired lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lazy-loading 'info_cache' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG nova.network.neutron [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [{"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Releasing lock "refresh_cache-f3365c50-a05d-4999-a081-30e88b4769f7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'flavor' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:08:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b39733b9-ea03-4473-8cad-448774234295 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:08:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 14:08:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:08:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:08:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.919326782226562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Instance f3365c50-a05d-4999-a081-30e88b4769f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:08:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:08:29 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:08:29 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:08:29 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:08:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:08:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:08:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:08:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:08:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:08:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:08:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:08:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:09:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:09:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:09:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:09:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:09:22 user nova-compute[75071]: INFO nova.compute.manager [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Terminating instance
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-a2ae2338-f479-4b42-b1a9-d1e9936fbbe6 req-5aae4f2b-cd95-4d06-bc27-cf87d02e7e27 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-vif-unplugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a2ae2338-f479-4b42-b1a9-d1e9936fbbe6 req-5aae4f2b-cd95-4d06-bc27-cf87d02e7e27 service nova] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a2ae2338-f479-4b42-b1a9-d1e9936fbbe6 req-5aae4f2b-cd95-4d06-bc27-cf87d02e7e27 service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a2ae2338-f479-4b42-b1a9-d1e9936fbbe6 req-5aae4f2b-cd95-4d06-bc27-cf87d02e7e27 service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-a2ae2338-f479-4b42-b1a9-d1e9936fbbe6 req-5aae4f2b-cd95-4d06-bc27-cf87d02e7e27 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] No waiting events found dispatching network-vif-unplugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-a2ae2338-f479-4b42-b1a9-d1e9936fbbe6 req-5aae4f2b-cd95-4d06-bc27-cf87d02e7e27 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-vif-unplugged-29b0db46-0d70-4259-9408-98833af95801 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Instance destroyed successfully.
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lazy-loading 'resources' on Instance uuid f3365c50-a05d-4999-a081-30e88b4769f7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T14:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-726020252',display_name='tempest-SnapshotDataIntegrityTests-server-726020252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-726020252',id=53,image_ref='794347ff-8cf3-49d9-8652-9f89337799af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlqdzKck7D6MjM7+LD+QbuPg04ef03iLpOhQOsCckG7dE7eF8yB4JmUzgcjPwMODTFQoyq94zL/t8JnERWXLmm7UnWSWatxnGBqby45D4TBp+718pbJBhd59jmlCJCM0A==',key_name='tempest-keypair-358523378',keypairs=<?>,launch_index=0,launched_at=2023-11-29T14:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66ccff9cc11c40b5986b0b45fe959132',ramdisk_id='',reservation_id='r-ln0m20ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='794347ff-8cf3-49d9-8652-9f89337799af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1148232701',owner_user_name='tempest-SnapshotDataIntegrityTests-1148232701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T14:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66186700b0ad4842b59747c1eefd0ea1',uuid=f3365c50-a05d-4999-a081-30e88b4769f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Converting VIF {"id": "29b0db46-0d70-4259-9408-98833af95801", "address": "fa:16:3e:25:eb:43", "network": {"id": "e560d562-e9d3-4c54-874a-da48dd8da518", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2021929155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66ccff9cc11c40b5986b0b45fe959132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b0db46-0d", "ovs_interfaceid": "29b0db46-0d70-4259-9408-98833af95801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:eb:43,bridge_name='br-int',has_traffic_filtering=True,id=29b0db46-0d70-4259-9408-98833af95801,network=Network(e560d562-e9d3-4c54-874a-da48dd8da518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0db46-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG os_vif [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:eb:43,bridge_name='br-int',has_traffic_filtering=True,id=29b0db46-0d70-4259-9408-98833af95801,network=Network(e560d562-e9d3-4c54-874a-da48dd8da518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0db46-0d') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29b0db46-0d, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49cf822c-247f-4902-9865-687adda690f4) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:22 user nova-compute[75071]: INFO os_vif [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:eb:43,bridge_name='br-int',has_traffic_filtering=True,id=29b0db46-0d70-4259-9408-98833af95801,network=Network(e560d562-e9d3-4c54-874a-da48dd8da518),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b0db46-0d')
Nov 29 14:09:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Deleting instance files /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7_del
Nov 29 14:09:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Deletion of /opt/stack/data/nova/instances/f3365c50-a05d-4999-a081-30e88b4769f7_del complete
Nov 29 14:09:22 user nova-compute[75071]: INFO nova.compute.manager [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 14:09:22 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 14:09:22 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 14:09:23 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 14:09:23 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Took 0.74 seconds to deallocate network for instance.
Nov 29 14:09:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:09:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:09:23 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:09:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:09:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:09:23 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Deleted allocations for instance f3365c50-a05d-4999-a081-30e88b4769f7
Nov 29 14:09:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b64e1af2-f57f-4ece-b8b2-1e248f3a03a1 tempest-SnapshotDataIntegrityTests-1148232701 tempest-SnapshotDataIntegrityTests-1148232701-project-member] Lock "f3365c50-a05d-4999-a081-30e88b4769f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:09:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-c8e90796-be75-4739-bdbd-a12fe0cdc8f7 req-807c6582-4eaf-4e03-8ba3-04418a506816 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:09:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8e90796-be75-4739-bdbd-a12fe0cdc8f7 req-807c6582-4eaf-4e03-8ba3-04418a506816 service nova] Acquiring lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:09:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8e90796-be75-4739-bdbd-a12fe0cdc8f7 req-807c6582-4eaf-4e03-8ba3-04418a506816 service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:09:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c8e90796-be75-4739-bdbd-a12fe0cdc8f7 req-807c6582-4eaf-4e03-8ba3-04418a506816 service nova] Lock "f3365c50-a05d-4999-a081-30e88b4769f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:09:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-c8e90796-be75-4739-bdbd-a12fe0cdc8f7 req-807c6582-4eaf-4e03-8ba3-04418a506816 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] No waiting events found dispatching network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 14:09:24 user nova-compute[75071]: WARNING nova.compute.manager [req-c8e90796-be75-4739-bdbd-a12fe0cdc8f7 req-807c6582-4eaf-4e03-8ba3-04418a506816 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received unexpected event network-vif-plugged-29b0db46-0d70-4259-9408-98833af95801 for instance with vm_state deleted and task_state None.
Nov 29 14:09:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-c8e90796-be75-4739-bdbd-a12fe0cdc8f7 req-807c6582-4eaf-4e03-8ba3-04418a506816 service nova] [instance: f3365c50-a05d-4999-a081-30e88b4769f7] Received event network-vif-deleted-29b0db46-0d70-4259-9408-98833af95801 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 14:09:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:09:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:09:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:09:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:09:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:09:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=9117MB free_disk=24.94643783569336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing inventories for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating ProviderTree inventory for provider e517bf91-8e31-44c7-82cf-bb88030161c7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Updating inventory in ProviderTree for provider e517bf91-8e31-44c7-82cf-bb88030161c7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing aggregate associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Refreshing trait associations for resource provider e517bf91-8e31-44c7-82cf-bb88030161c7, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:09:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:09:32 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:09:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 14:09:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 14:09:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 14:09:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:09:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:09:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:10:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:10:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:10:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:10:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:10:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:10:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:10:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=9240MB free_disk=24.937480926513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:10:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:10:29 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:31 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:10:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:10:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:10:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:10:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:11:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 14:11:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:11:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:11:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:11:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:11:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 14:11:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 14:11:29 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:11:29 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Hypervisor/Node resource view: name=user free_ram=9237MB free_disk=24.930042266845703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed in ProviderTree for provider: e517bf91-8e31-44c7-82cf-bb88030161c7 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Inventory has not changed for provider e517bf91-8e31-44c7-82cf-bb88030161c7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 14:11:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 14:11:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-693ef854-9add-4ac2-8be8-9b1f76362250 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 14:11:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 14:11:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 14:11:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:11:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 14:11:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 14:11:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}